Apparatus and method for processing image received through a plurality of cameras

ABSTRACT

An electronic device is provided. The electronic device includes a first camera group including a first camera disposed in a first optical axis direction and a second camera disposed in a second optical axis direction, and having a first field of view (FOV), a second camera group including a third camera disposed in a third optical axis direction and a fourth camera disposed in a fourth optical axis direction, and having a second FOV covering an area at least partially different from an area covered by the first FOV, a first processor configured to process images acquired through the first camera group, a second processor configured to process images acquired through the second camera group, and a designated processor configured to control the first processor and the second processor.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is based on and claims priority under 35 U.S.C. § 119of a Korean patent application number 10-2017-0116214, filed on Sep. 11,2017, in the Korean Intellectual Property Office, the disclosure ofwhich is incorporated by reference herein in its entirety.

BACKGROUND 1. Field

The disclosure relates to an apparatus and a method for processing animage received through a plurality of cameras.

2. Description of Related Art

With the development of technology, the distribution of virtual realitycontents is increasing. In order to generate such contents, apparatusesfor processing images such as panoramic images and omnidirectionalimages are being developed. Such apparatuses may acquire a plurality ofimages for an omnidirectional image or may generate an image such as apanoramic image or an omnidirectional image based on the plurality ofacquired images.

The above information is presented as background information only toassist with an understanding of the disclosure. No determination hasbeen made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the disclosure.

SUMMARY

Aspects of the disclosure are to address at least the above-mentionedproblems and/or disadvantages and to provide at least the advantagesdescribed below.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented embodiments.

In accordance with an aspect of the disclosure, an electronic device isprovided. The electronic device includes a first camera group includinga first camera disposed in a first optical axis direction and a secondcamera disposed in a second optical axis direction, and having a firstfield of view (FOV), a second camera group including a third cameradisposed in a third optical axis direction and a fourth camera disposedin a fourth optical axis direction, and having a second FOV covering anarea at least partially different from an area covered by the first FOV,a first processor configured to process images acquired through thefirst camera group, a second processor configured to process imagesacquired through the second camera group, and a designated processorconfigured to control the first processor and the second processor. Thedesignated processor may be configured to select an operation modeassociated with the first processor or the second processor, at leastbased on an input associated with the first camera group or the secondcamera group, when the operation mode is selected as a first operationmode, acquire an image covering the first FOV using first imagesprocessed through the first processor, and when the operation mode isselected as a second operation mode, acquire an image covering the firstFOV and the second FOV using the first images processed through thefirst processor and second images processed through the secondprocessor.

In accordance with another aspect of the disclosure, an apparatus isprovided. The apparatus includes a first camera pair including a firstcamera configured to be oriented in a first direction and a secondcamera configured to be oriented in a second direction corresponding tothe first direction, the first camera having a first FOV and the secondcamera having a second FOV partially overlapping the first FOV, at leastone memory, a first processor, a second processor connected to the firstcamera, and a third processor connected to the second camera. The firstprocessor may be configured to in response to the apparatus operating ina first mode for generating a two-dimensional space (2D) image, requestencoded data from the third processor, receive, from the thirdprocessor, second encoded data on an image acquired through the secondcamera, and store the second encoded data in the at least one memory asone data set, and in response to the apparatus operating in a secondmode for generating a three-dimensional space (3D) image, requestencoded data from the second processor and the third processor, receive,from the third processor, a first encoded data on an image acquiredthrough the first camera and the second encoded data on an imageacquired through the second camera, and store the first encoded data andthe second encoded data in the at least one memory as the one data set.

In accordance with another aspect of the disclosure, in a method of anapparatus, an apparatus is provided. The apparatus includes a firstcamera pair including a first camera connected to a second processor andconfigured to be oriented in the first direction and a second cameraconnected to a third processor and configured to be oriented in a seconddirection corresponding to the first direction, the first camera havinga first FOV and the second camera having a second FOV partiallyoverlapping the first FOV, and the method may include requesting encodeddata from the third processor connected to the second camera if thefirst camera pair in response to the apparatus operating in a first modefor generating 2D image, receiving, from the third processor, secondencoded data for an image acquired through the second camera, storingthe second encoded data in at least one memory as one data set,requesting the encoded data from the second processor and the thirdprocessor connected to the first camera in response to the apparatusoperating in a second mode for generating a 3D image, receiving a firstencoded data for an image acquired through the first camera from thethird processor and the second encoded data for an image acquiredthrough the second camera, and storing the first encoded data and thesecond encoded data in the at least one memory as one data set.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the disclosure will be more apparent from the followingdescription taken in conjunction with the accompanying drawings, inwhich:

FIG. 1 is a block diagram illustrating an electronic device forprocessing an omnidirectional image, in a network environment, accordingto an embodiment of the disclosure;

FIG. 2 is a block diagram of a camera module according to an embodimentof the disclosure;

FIG. 3 illustrates an example of the functional configuration of anapparatus that acquires a plurality of images according to an embodimentof the disclosure;

FIG. 4 is a perspective view of an electronic device according to anembodiment of the disclosure;

FIG. 5 is an exploded perspective view of an electronic device accordingto an embodiment of the disclosure;

FIG. 6 shows the field of view (FOV) of a camera according to anembodiment of the disclosure;

FIG. 7 illustrates a stereoscopic pair of cameras according to anembodiment of the disclosure;

FIG. 8 illustrates a portion of a top view of a camera arrangement of acamera system according to an embodiment of the disclosure;

FIG. 9 is a side view of a camera system according to an embodiment ofthe disclosure;

FIG. 10 illustrates a set of overlapped images captured by the camerasystem according to an embodiment of the disclosure;

FIGS. 11A and 11B are plan views illustrating an example of a printedcircuit board (PCB) according to various embodiments of the disclosure;

FIG. 12 is a plan view illustrating another example of a PCB accordingto an embodiment of the disclosure;

FIGS. 13A, 13B, and 13C illustrate examples of an arrangement structureof a plurality of cameras and a PCB according to various embodiments ofthe disclosure;

FIG. 14 illustrates an example of a functional configuration of anapparatus that controls power according to an embodiment of thedisclosure;

FIG. 15 illustrates an example of another example of a functionalconfiguration of an apparatus that controls power according to anembodiment of the disclosure;

FIG. 16 illustrate an example of a plurality of images acquired by anapparatus according to an embodiment of the disclosure;

FIG. 17 illustrates an example of an operation of an apparatus thatcontrols power according to an embodiment of the disclosure;

FIG. 18 illustrates an example of signal flow in an apparatus thatcontrols power according to an embodiment of the disclosure;

FIG. 19 illustrates an example of a mode control operation of anapparatus that controls power according to an embodiment of thedisclosure;

FIG. 20 illustrates an example of a user interface (UI) displayed in anapparatus according to an embodiment of the disclosure;

FIG. 21 illustrates another example of a mode control operation of anapparatus that controls power according to an embodiment of thedisclosure of the disclosure;

FIG. 22 illustrates another example of a UI displayed in an apparatusaccording to an embodiment of the disclosure;

FIG. 23 illustrates an example of a functional configuration of anapparatus that controls image processing according to an embodiment ofthe disclosure;

FIG. 24 illustrates another example of a functional configuration of anapparatus that controls image processing according to an embodiment ofthe disclosure;

FIG. 25 illustrates still another example of a functional configurationof an apparatus that controls image processing according to anembodiment of the disclosure;

FIG. 26 illustrates still another example of a functional configurationof an apparatus that controls image processing according to anembodiment of the disclosure;

FIG. 27 illustrates an example of an operation of an apparatus thatcontrols image processing according to an embodiment of the disclosure;

FIG. 28 illustrates an example of a signal flow in an apparatus thatcontrols image processing according to an embodiment of the disclosure;

FIG. 29 illustrates an example of an operation of another apparatus thatreceives a data set according to an embodiment of the disclosure;

FIG. 30 illustrates an example of a functional configuration of anelectronic device that processes an audio signal according to anembodiment of the disclosure;

FIG. 31 illustrates an example of an operation of a processor thatprocesses an audio signal according to an embodiment of the disclosure;

FIG. 32 illustrates another example of changing a direction of audio inan electronic device according to an embodiment of the disclosure;

FIG. 33 illustrates an example of an operation of an apparatus thatprocesses an audio signal according to an embodiment of the disclosure;

FIG. 34 illustrates an example of an operation of an electronic devicethat generates a plurality of second audio signals according to anembodiment of the disclosure;

FIG. 35 illustrates an example of the plurality of generated secondaudio signals according to an embodiment of the disclosure;

FIG. 36 illustrates an example of the functional configuration of anapparatus that compensates for distortion according to an embodiment ofthe disclosure;

FIG. 37 illustrates an example of a method for determining informationfor compensating for distortion according to an embodiment of thedisclosure;

FIG. 38 illustrates an example of an image for compensating fordistortion according to an embodiment of the disclosure;

FIG. 39 illustrates another example of an image for compensating fordistortion according to an embodiment of the disclosure;

FIG. 40 illustrates another example of a method for determininginformation for compensating for distortion according to an embodimentof the disclosure;

FIG. 41 illustrates another example of an apparatus that transmitsinformation for compensating for distortion according to an embodimentof the disclosure; and

FIG. 42 illustrates an example of an operation of an apparatus thatprovides a distortion compensation mode according to an embodiment ofthe disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thedisclosure. In addition, descriptions of well-known functions andconstructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of thedisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of thedisclosure is provided for illustration purpose only and not for thepurpose of limiting the disclosure as defined by the appended claims andtheir equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

FIG. 1 is a block diagram illustrating an electronic device 101 in anetwork environment 100 according to various embodiments of thedisclosure.

Referring to FIG. 1, the electronic device 101 in the networkenvironment 100 may communicate with an electronic device 102 via afirst network 198 (e.g., a short-range wireless communication network),or an electronic device 104 or a server 108 via a second network 199(e.g., a long-range wireless communication network). According to anembodiment, the electronic device 101 may communicate with theelectronic device 104 via the server 108. According to an embodiment,the electronic device 101 may include a processor 120, memory 130, aninput device 150, a sound output device 155, a display device 160, anaudio module 170, a sensor module 176, an interface 177, a haptic module179, a camera module 180, a power management module 188, a battery 189,a communication module 190, a subscriber identification module (SIM)196, or an antenna module 197. In some embodiments, at least one (e.g.,the display device 160 or the camera module 180) of the components maybe omitted from the electronic device 101, or one or more othercomponents may be added in the electronic device 101. In someembodiments, some of the components may be implemented as singleintegrated circuitry. For example, the sensor module 176 (e.g., afingerprint sensor, an iris sensor, or an illuminance sensor) may beimplemented as embedded in the display device 160 (e.g., a display).

The processor 120 may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 101 coupled with theprocessor 120, and may perform various data processing or computation.According to one embodiment, as at least part of the data processing orcomputation, the processor 120 may load a command or data received fromanother component (e.g., the sensor module 176 or the communicationmodule 190) in volatile memory 132, process the command or the datastored in the volatile memory 132, and store resulting data innon-volatile memory 134. According to an embodiment, the processor 120may include a main processor 121 (e.g., a central processing unit (CPU)or an application processor (AP)), and an auxiliary processor 123 (e.g.,a graphics processing unit (GPU), an image signal processor (ISP), asensor hub processor, or a communication processor (CP)) that isoperable independently from, or in conjunction with, the main processor121. Additionally or alternatively, the auxiliary processor 123 may beadapted to consume less power than the main processor 121, or to bespecific to a specified function. The auxiliary processor 123 may beimplemented as separate from, or as part of the main processor 121.

The auxiliary processor 123 may control at least some of functions orstates related to at least one component (e.g., the display device 160,the sensor module 176, or the communication module 190) among thecomponents of the electronic device 101, instead of the main processor121 while the main processor 121 is in an inactive (e.g., sleep) state,or together with the main processor 121 while the main processor 121 isin an active state (e.g., executing an application). According to anembodiment, the auxiliary processor 123 (e.g., an ISP or a CP) may beimplemented as part of another component (e.g., the camera module 180 orthe communication module 190) functionally related to the auxiliaryprocessor 123.

The memory 130 may store various data used by at least one component(e.g., the processor 120 or the sensor module 176) of the electronicdevice 101. The various data may include, for example, software (e.g.,the program 140) and input data or output data for a command relatedthereto. The memory 130 may include the volatile memory 132 or thenon-volatile memory 134.

The program 140 may be stored in the memory 130 as software, and mayinclude, for example, an operating system (OS) 142, middleware 144, oran application 146.

The input device 150 may receive a command or data to be used by anothercomponent (e.g., the processor 120) of the electronic device 101, fromthe outside (e.g., a user) of the electronic device 101. The inputdevice 150 may include, for example, a microphone, a mouse, or akeyboard.

The sound output device 155 may output sound signals to the outside ofthe electronic device 101. The sound output device 155 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as playing multimedia or playing record, and the receivermay be used for incoming calls. According to an embodiment, the receivermay be implemented as separate from, or as part of the speaker.

The display device 160 may visually provide information to the outside(e.g., a user) of the electronic device 101. The display device 160 mayinclude, for example, a display, a hologram device, or a projector andcontrol circuitry to control a corresponding one of the display,hologram device, and projector. According to an embodiment, the displaydevice 160 may include touch circuitry adapted to detect a touch, orsensor circuitry (e.g., a pressure sensor) adapted to measure theintensity of force incurred by the touch.

The audio module 170 may convert a sound into an electrical signal andvice versa. According to an embodiment, the audio module 170 may obtainthe sound via the input device 150, or output the sound via the soundoutput device 155 or a headphone of an external electronic device (e.g.,an electronic device 102) directly (e.g., wiredly) or wirelessly coupledwith the electronic device 101.

The sensor module 176 may detect an operational state (e.g., power ortemperature) of the electronic device 101 or an environmental state(e.g., a state of a user) external to the electronic device 101, andthen generate an electrical signal or data value corresponding to thedetected state. According to an embodiment, the sensor module 176 mayinclude, for example, a gesture sensor, a gyro sensor, an atmosphericpressure sensor, a magnetic sensor, an acceleration sensor, a gripsensor, a proximity sensor, a color sensor, an infrared (IR) sensor, abiometric sensor, a temperature sensor, a humidity sensor, or anilluminance sensor.

The interface 177 may support one or more specified protocols to be usedfor the electronic device 101 to be coupled with the external electronicdevice (e.g., the electronic device 102) directly (e.g., wiredly) orwirelessly. According to an embodiment, the interface 177 may include,for example, a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a secure digital (SD) card interface, or anaudio interface.

A connecting terminal 178 may include a connector via which theelectronic device 101 may be physically connected with the externalelectronic device (e.g., the electronic device 102). According to anembodiment, the connecting terminal 178 may include, for example, a HDMIconnector, a USB connector, a SD card connector, or an audio connector(e.g., a headphone connector),

The haptic module 179 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or a movement) or electrical stimulus whichmay be recognized by a user via his tactile sensation or kinestheticsensation. According to an embodiment, the haptic module 179 mayinclude, for example, a motor, a piezoelectric element, or an electricstimulator.

The camera module 180 may capture a still image or moving images.According to an embodiment, the camera module 180 may include one ormore lenses, image sensors, ISPs, or flashes.

The power management module 188 may manage power supplied to theelectronic device 101. According to one embodiment, the power managementmodule 188 may be implemented as at least part of, for example, a powermanagement integrated circuit (PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. According to an embodiment, the battery 189 mayinclude, for example, a primary cell which is not rechargeable, asecondary cell which is rechargeable, or a fuel cell.

The communication module 190 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 101 and the external electronic device (e.g., theelectronic device 102, the electronic device 104, or the server 108) andperforming communication via the established communication channel. Thecommunication module 190 may include one or more CPs that are operableindependently from the processor 120 (e.g., the AP) and supports adirect (e.g., wired) communication or a wireless communication.According to an embodiment, the communication module 190 may include awireless communication module 192 (e.g., a cellular communicationmodule, a short-range wireless communication module, or a globalnavigation satellite system (GNSS) communication module) or a wiredcommunication module 194 (e.g., a local area network (LAN) communicationmodule or a power line communication (PLC) module). A corresponding oneof these communication modules may communicate with the externalelectronic device via the first network 198 (e.g., a short-rangecommunication network, such as Bluetooth™, wireless-fidelity (Wi-Fi)direct, or infrared data association (IrDA)) or the second network 199(e.g., a long-range communication network, such as a cellular network,the Internet, or a computer network (e.g., LAN or wide area network(WAN)). These various types of communication modules may be implementedas a single component (e.g., a single chip), or may be implemented asmulti components (e.g., multi chips) separate from each other. Thewireless communication module 192 may identify and authenticate theelectronic device 101 in a communication network, such as the firstnetwork 198 or the second network 199, using subscriber information(e.g., international mobile subscriber identity (IMSI)) stored in thesubscriber identification module 196.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. According to an embodiment, the antenna module197 may include one or more antennas, and, therefrom, at least oneantenna appropriate for a communication scheme used in the communicationnetwork, such as the first network 198 or the second network 199, may beselected, for example, by the communication module 190 (e.g., thewireless communication module 192). The signal or the power may then betransmitted or received between the communication module 190 and theexternal electronic device via the selected at least one antenna.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted orreceived between the electronic device 101 and the external electronicdevice 104 via the server 108 coupled with the second network 199. Eachof the electronic devices 102 and 104 may be a device of a same type as,or a different type, from the electronic device 101. According to anembodiment, all or some of operations to be executed at the electronicdevice 101 may be executed at one or more of the external electronicdevices 102, 104, or 108. For example, if the electronic device 101should perform a function or a service automatically, or in response toa request from a user or another device, the electronic device 101,instead of, or in addition to, executing the function or the service,may request the one or more external electronic devices to perform atleast part of the function or the service. The one or more externalelectronic devices receiving the request may perform the at least partof the function or the service requested, or an additional function oran additional service related to the request, and transfer an outcome ofthe performing to the electronic device 101. The electronic device 101may provide the outcome, with or without further processing of theoutcome, as at least part of a reply to the request. To that end, acloud computing, distributed computing, or client-server computingtechnology may be used, for example.

FIG. 2 is a block diagram 200 illustrating the camera module 180according to various embodiments of the disclosure.

Referring to FIG. 2, the camera module 180 may include a lens assembly210, a flash 220, an image sensor 230, an image stabilizer 240, memory250 (e.g., buffer memory), or an ISP 260. The lens assembly 210 maycollect light emitted or reflected from an object whose image is to betaken. The lens assembly 210 may include one or more lenses. Accordingto an embodiment, the camera module 180 may include a plurality of lensassemblies 210. In such a case, the camera module 180 may form, forexample, a dual camera, a 360-degree camera, or a spherical camera. Someof the plurality of lens assemblies 210 may have the same lens attribute(e.g., view angle, focal length, auto-focusing, f number, or opticalzoom), or at least one lens assembly may have one or more lensattributes different from those of another lens assembly. The lensassembly 210 may include, for example, a wide-angle lens or a telephotolens.

The flash 220 may emit light that is used to reinforce light reflectedfrom an object. According to an embodiment, the flash 220 may includeone or more light emitting diodes (LEDs) (e.g., a red-green-blue (RGB)LED, a white LED, an IR LE310D, or an ultraviolet (UV) LED) or a xenonlamp. The image sensor 230 may obtain an image corresponding to anobject by converting light emitted or reflected from the object andtransmitted via the lens assembly 210 into an electrical signal.According to an embodiment, the image sensor 230 may include oneselected from image sensors having different attributes, such as an RGBsensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor, aplurality of image sensors having the same attribute, or a plurality ofimage sensors having different attributes. Each image sensor included inthe image sensor 230 may be implemented using, for example, a chargedcoupled device (CCD) sensor or a complementary metal oxide semiconductor(CMOS) sensor.

The image stabilizer 240 may move the image sensor 230 or at least onelens included in the lens assembly 210 in a particular direction, orcontrol an operational attribute (e.g., adjust the read-out timing) ofthe image sensor 230 in response to the movement of the camera module180 or the electronic device 101 including the camera module 180. Thisallows compensating for at least part of a negative effect (e.g., imageblurring) by the movement on an image being captured. According to anembodiment, the image stabilizer 240 may sense such a movement by thecamera module 180 or the electronic device 101 using a gyro sensor (notshown) or an acceleration sensor (not shown) disposed inside or outsidethe camera module 180. According to an embodiment, the image stabilizer240 may be implemented, for example, as an optical image stabilizer.

The memory 250 may store, at least temporarily, at least part of animage obtained via the image sensor 230 for a subsequent imageprocessing task. For example, if image capturing is delayed due toshutter lag or multiple images are quickly captured, a raw imageobtained (e.g., a Bayer-patterned image, a high-resolution image) may bestored in the memory 250, and its corresponding copy image (e.g., alow-resolution image) may be previewed via the display device 160.Thereafter, if a specified condition is met (e.g., by a user's input orsystem command), at least part of the raw image stored in the memory 250may be obtained and processed, for example, by the ISP 260. According toan embodiment, the memory 250 may be configured as at least part of thememory 130 or as a separate memory that is operated independently fromthe memory 130.

The ISP 260 may perform one or more image processing with respect to animage obtained via the image sensor 230 or an image stored in the memory250. The one or more image processing may include, for example, depthmap generation, three-dimensional (3D) modeling, panorama generation,feature point extraction, image synthesizing, or image compensation(e.g., noise reduction, resolution adjustment, brightness adjustment,blurring, sharpening, or softening). Additionally or alternatively, theISP 260 may perform control (e.g., exposure time control or read-outtiming control) with respect to at least one (e.g., the image sensor230) of the components included in the camera module 180. An imageprocessed by the ISP 260 may be stored back in the memory 250 forfurther processing, or may be provided to an external component (e.g.,the memory 130, the display device 160, the electronic device 102, theelectronic device 104, or the server 108) outside the camera module 180.According to an embodiment, the ISP 260 may be configured as at leastpart of the processor 120, or as a separate processor that is operatedindependently from the processor 120. If the ISP 260 is configured as aseparate processor from the processor 120, at least one image processedby the ISP 260 may be displayed, by the processor 120, via the displaydevice 160 as it is or after being further processed.

According to an embodiment, the electronic device 101 may include aplurality of camera modules 180 having different attributes orfunctions. In such a case, at least one of the plurality of cameramodules 180 may form, for example, a wide-angle camera and at leastanother of the plurality of camera modules 180 may form a telephotocamera. Similarly, at least one of the plurality of camera modules 180may form, for example, a front camera and at least another of theplurality of camera modules 180 may form a rear camera.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smart phone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. According toan embodiment of the disclosure, the electronic devices are not limitedto those described above.

It should be appreciated that various embodiments of the disclosure andthe terms used therein are not intended to limit the technologicalfeatures set forth herein to particular embodiments and include variouschanges, equivalents, or replacements for a corresponding embodiment.With regard to the description of the drawings, similar referencenumerals may be used to refer to similar or related elements. It is tobe understood that a singular form of a noun corresponding to an itemmay include one or more of the things, unless the relevant contextclearly indicates otherwise. As used herein, each of such phrases as “Aor B,” “at least one of A and B,” “at least one of A or B,” “A, B, orC,” “at least one of A, B, and C,” and “at least one of A, B, or C,” mayinclude all possible combinations of the items enumerated together in acorresponding one of the phrases. As used herein, such terms as “1st”and “2nd,” or “first” and “second” may be used to simply distinguish acorresponding component from another, and does not limit the componentsin other aspect (e.g., importance or order). It is to be understood thatif an element (e.g., a first element) is referred to, with or withoutthe term “operatively” or “communicatively”, as “coupled with,” “coupledto,” “connected with,” or “connected to” another element (e.g., a secondelement), it means that the element may be coupled with the otherelement directly (e.g., wiredly), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms, for example, “logic,” “logic block,” “part,” or“circuitry”. A module may be a single integral component, or a minimumunit or part thereof, adapted to perform one or more functions. Forexample, according to an embodiment, the module may be implemented in aform of an application-specific integrated circuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 140) including one or more instructions that arestored in a storage medium (e.g., internal memory 136 or external memory138) that is readable by a machine (e.g., the electronic device 101).For example, a processor (e.g., the processor 120) of the machine (e.g.,the electronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a complier or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments ofthe disclosure may be included and provided in a computer programproduct. The computer program product may be traded as a product betweena seller and a buyer. The computer program product may be distributed inthe form of a machine-readable storage medium (e.g., compact disc readonly memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded)online via an application store (e.g., Play Store™), or between two userdevices (e.g., smart phones) directly. If distributed online, at leastpart of the computer program product may be temporarily generated or atleast temporarily stored in the machine-readable storage medium, such asmemory of the manufacturer's server, a server of the application store,or a relay server.

According to various embodiments, each component (e.g., a module or aprogram) of the above-described components may include a single entityor multiple entities. According to various embodiments, one or more ofthe above-described components may be omitted, or one or more othercomponents may be added. Alternatively or additionally, a plurality ofcomponents (e.g., modules or programs) may be integrated into a singlecomponent. In such a case, according to various embodiments, theintegrated component may still perform one or more functions of each ofthe plurality of components in the same or similar manner as they areperformed by a corresponding one of the plurality of components beforethe integration. According to various embodiments, operations performedby the module, the program, or another component may be carried outsequentially, in parallel, repeatedly, or heuristically, or one or moreof the operations may be executed in a different order or omitted, orone or more other operations may be added.

FIG. 3 illustrates an example of the functional configuration of anapparatus that acquires a plurality of images according to variousembodiments of the disclosure.

Referring to FIG. 3, the apparatus 300 may include a processor 310, amemory 320, a camera 330, a communication interface 340, a PMIC 350, amicrophone 360, an input device 370, and/or a display 390.

The processor 310 may control one or more other components (e.g., ahardware or software component) of the apparatus 300, which areconnected to the processor 310, and may perform various data processingand arithmetic operations by driving, for example, software (e.g., aprogram or an instruction word). The processor 310 may load instructionsor data, which are received from the other components (e.g., the camera330 or the communication interface 340), into a volatile memory 320 soas to process the instructions or data, and may store the resulting datainto a non-volatile memory (e.g., the memory 320). In variousembodiments, the processor 310 may include a main processor (e.g., acentral processing unit (CPU), an application processor (AP), an ISP,and a digital signal processor (DSP). Additionally or alternatively, theprocessor 310 may include an auxiliary processor that is operatedindependently from the above-mentioned components and that uses lowerpower than the main processor or is specific to a designated function.The auxiliary may be operated separately from the main processor or inthe state of being embedded in the main processor.

In this case, the auxiliary processor may be used, in place of the mainprocessor while the main processor is in an inactive (e.g., sleep) stateor together with the main processor while the main processor is in anactive (e.g., functioning), so as to control at least some of thefunctions or states associated with at least one component (e.g., thecamera 330 or the communication interface 340) among the components ofthe apparatus. In various embodiments, the auxiliary processor may beimplemented as a component of some other functionally associatedcomponents (e.g., the camera 330 or the communication interface 340). Invarious embodiments, when a plurality of processors 310 are provided,the processors 310 may include a processor configured to control theoverall operation of the apparatus 300 and a processor configured tocontrol the operation of the camera 330 or to process an image acquiredthrough the camera 330. The number of processors 310 may vary dependingon the number of cameras 330 or the size of the image acquired throughthe camera. For example, when the number of cameras 330 is 17, thenumber of processors 310 may be five. For example, the processor 310 mayinclude a first processor connected to one camera and controlling theoverall operation of the apparatus 300, and second to fourth processorsrespectively connected to four cameras. Each of the first to fifthprocessors may control at least one camera connected to each of thefirst to fifth processors. Each of the first to fifth processors mayencode an image acquired through at least one camera connected to eachof the first to fifth processors.

The memory 320 may include a plurality of programs (or instructionwords). The plurality of programs may be executed by the processor 310.The plurality of programs may include an OS, middleware, a devicedriver, or an application. The memory 320 may include a volatile memory,a non-volatile memory, and/or a non-volatile medium. In variousembodiments, the volatile memory may include a dynamic random accessmemory (DRAM), a static RAM (SRAM), a synchronous DRAM (SDRAM), aphase-change RAM (PRAM), a magnetic RAM (MRAM), a resistive RAM (ReRAM),a ferroelectric RAM (FeRAM), or the like. In various embodiments, thenon-volatile memory may include a ROM, a programmable ROM (PROM), anelectrically programmable ROM (EPROM), an electrically erasable ROM(EEPROM), a flash memory, or the like. In various embodiments, thenon-volatile medium may include a hard disk drive (HDD), a solid-statedisk (SSD), an embedded multi-media card (eMMC), a universal flashstorage (UFS), a SD card, or the like.

The camera 330 may capture a still image and a moving image. In variousembodiments, the camera 330 may include one or more lenses, one or moreimage sensors, or one or more flashes. In various embodiments, thecamera 330 may include a camera for acquiring an image of a scene of anupper portion of the apparatus 300 and a camera for acquiring an imageof a scene of a side portion of the apparatus 300. In variousembodiments, when the camera 330 includes a plurality of cameras, atleast some of the plurality of cameras may be configured as pairs ofcameras. In various embodiments, the field of view (FOV) of each of theplurality of cameras may partially overlap of the FOVs of the othercameras. With such an overlap, the camera 330 is capable of acquiring aplurality of images for generating an omnidirectional image. The camera330 may provide information on the acquired plurality of images to theprocessor 310.

The communication interface 340 may support establishing a wired orwireless communication channel between the apparatus 300 and anotherapparatus (e.g., the apparatus 300 illustrated in FIG. 3), andperforming a communication over the established communication channel.In various embodiments, the communication interface 340 may be awireless communication module (e.g., a cellular communication module, ashort range wireless communication module, or a GNSS communicationmodule) or a wired communication module (e.g., a USB communicationmodule, a universal asynchronous receiver/transmitter (UART)communication module, a LAN communication module, or a PLC module), andthe apparatus may communicate with other apparatuses using acorresponding communication module among the above-mentionedcommunication modules through a short range communication network, along range communication network, or a computer network. Thecommunication modules may be implemented as a single chip or may beimplemented as separate chips, respectively.

The communication interface 340 may include an I/O interface providedfor communication between one or more I/O devices and the apparatus 300.The one or more I/O devices may be a keyboard, a keypad, an externalmicrophone, an external monitor, a mouse, a printer, a scanner, aspeaker, a still camera, a stylus, a tablet, a touch screen, a trackball, a video camera, etc. The I/O interface may support a designatedprotocol that may be connected to the one or more I/O devices in a wiredor wireless manner. In various embodiments, the I/O interface 380 mayinclude a HDMI, a USB interface, an SD card interface, or an audiointerface.

The PMIC 350 may be used to supply power to at least one component ofthe apparatus 300 (e.g., the processor 310 or the communicationinterface 340). The PMIC 350 may be configured with a switchingregulator or a linear regulator. There may be provided a plurality ofPMICs 350 in order to supply power to each of the plurality of camerasor to supply power to each of the plurality of processors. For example,the plurality of PMICs 350 may include a first PMIC connected to thefirst processor, a second PMIC connected to the second processor, athird PMIC connected to the third processor, a fourth PMIC connected tothe fourth processor, and a fifth PMIC connected to the fifth processor.Each of the first to fifth processors may independently operates bybeing individually connected to the PMICs. For example, while the firstprocessor is supplied with power through the first PMIC, the supply ofpower to the second processor may be interrupted.

In various embodiments, the apparatus 300 may include a first PMIC forsupplying power to a camera associated with a first FOV and a processorassociated with (connected to) the camera associated with the first FOVand a second PMIC for supplying power to a camera associated with asecond FOV and a processor associated with (or connected to) the cameraassociated with the second FOV.

The microphone 360 may be used for acquiring audio. The microphone 360may acquire audio while acquiring a plurality of images through thecamera 330. There may be provide a plurality of microphones 360 in orderto provide sound (e.g., stereo sound or 5.1-channel sound) inreproducing the omnidirectional image. According to various embodiments,when the plurality of microphones 360 are provided, the plurality ofmicrophones may be configured to have directivity. For example, each ofthe plurality of microphones may be directionally distributed in theapparatus 300 in order to distinguish the directions of received audio.As another example, each of the plurality of microphones may provide ahigher gain to a predetermined component of the received audio based onthe direction of the received audio. According to various embodiments, aplurality of microphones 360 may be provided and the input direction ofthe audio signals may be identified by processing the signals receivedfrom the plurality of microphones. In various embodiments, theelectronic device 101 or the processor 310 may distinguish the inputdirections of the audio signals based at least on the input timedifference of the received signals.

The input device 370 may be a device for receiving instructions or datafrom the outside (e.g., the user) of the apparatus 300 for use in acomponent (e.g., the processor 310) of the apparatus 300. For example,the input device 370 may be configured with a touch screen capable ofreceiving a user's touch input. As another example, the input device 370may be configured with at least one physical key capable of receiving auser input.

The display 390 may be a device for visually presenting information tothe user of the apparatus 300. When the input device 370 is implementedwith a touch screen, the display 390 and the input device 370 may beimplemented as a single device.

The electronic device 101 or the apparatus 300 according to variousembodiments may perform the following procedures.

The apparatus (e.g., the apparatus 300 shown in FIG. 3) may acquire aplurality of images using a plurality of cameras. In variousembodiments, the apparatus may use a plurality of cameras so as toobtain a plurality of images for generating a composite image, such as apanoramic image or an omnidirectional image.

In various embodiments, at least some of the plurality of cameras may beconfigured as pairs of cameras. For example, a first one of theplurality of cameras and a second one of the plurality of cameras may beincluded in a first pair among the pairs of cameras. The first camera isconfigured to be oriented in a first direction and may have a first FOVor a first angle of view (AOV). The second camera may be configured tobe oriented in a second direction corresponding to the first direction,and may have a second FOV (or AOV) partially overlapping the first FOV.The FOV may indicate a range of a view in which a camera is capable ofcapturing an image. The FOV may be changed in accordance with the changeof the focus of a lens or the like. The FOV may be associated with anoptical axis.

In various embodiments, at least one of the plurality of images maypartially overlap at least one of the other images among the pluralityof images. The apparatus may acquire an image having a portionoverlapping another image in order to generate the omnidirectionalimage. In order to acquire some overlapped images, the FOV of at leastone of the plurality of cameras may partially overlap the FOV of atleast one of the other cameras among the plurality of cameras.

In various embodiments, the apparatus may control the plurality ofcameras such that the plurality of images are synchronized in startingor ending. The apparatus may acquire the plurality of images, which aresynchronized, by controlling the plurality of cameras.

In various embodiments, the apparatus may encode the plurality ofimages. The apparatus may include one or more processors for encodingthe plurality of images. The number of the one or more processors may beidentified based on the number of the plurality of images or the size ofeach of the plurality of images. For example, when the number of theplurality of images is 17, the number of the one or more processors maybe 5.

In various embodiments, each of the one or more processors may generateencoded data by encoding at least a part of the plurality of images. Theencoded data may be independently decodable.

A device that encodes the plurality of images may be a device, which isthe same as a device that acquires the plurality of images, or may be adevice distinct from the device that acquires the plurality of images.

The apparatus may generate an omnidirectional image by stitching theplurality of images based on the encoded data. In various embodiments,the apparatus may generate a plurality of decoded images by decoding theencoded data. The apparatus may generate the omnidirectional image bystitching (or compositing) the plurality of decoded images. Theapparatus may generate the omnidirectional image by stitching theplurality of decoded images based on an alignment of the plurality ofdecoded images.

The device that generates the omnidirectional image may be a device,which is the same as the device that acquires the plurality of images orthe device, which is the device that encodes the plurality of images, ormay be a device, which is distinct from the device that acquires theplurality of images or the device that encodes the plurality of images.

As described above, an omnidirectional image may be generated through aprocedure of acquiring the plurality of images, a procedure of encodingthe acquired plurality of images, and a procedure of performing imagestitching based on the encoded data. Various embodiments described belowmay be associated with such procedures.

FIG. 4 is a perspective view of an electronic device according tovarious embodiments of the disclosure.

Referring to FIG. 4, an electronic device 400 may include a housing 410that defines an external appearance and an inner space for mountinginternal components. The electronic device 400 may include a first face(or a top face) 4001 oriented in a first direction (e.g., the z-axisdirection), a second face (or a bottom face) 4003 disposed to beopposite the first surface 4001, and a third face (or a side face) 4002that surrounds the space defined by the first face 4001 and the secondsurface 4003.

According to various embodiments, the electronic device 400 may includea display 412 (e.g., display 390 of FIG. 3) and a navigation 411 (e.g.,the input device 370 of FIG. 3) disposed on the first face 4001 of thehousing 410. The display 412 may include a graphical user interface(GUI) of the electronic device 400. The user interface may display amenu for determining the mode of the electronic device 400 or the stateof the electronic device 400 (e.g., battery residual quantityinformation). The navigation 411 may be provided to the user as an inputmeans for navigating the GUI displayed on the display 412.Alternatively, the navigation 411 may function as a button for turningon/off the power of the electronic device 400. According to oneembodiment, the electronic device 400 may further include an indicator,a speaker, or the like disposed on the first face 4001 of the housing410. The indicator may include, for example, an LED device and mayvisually provide the state information of the electronic device 400 tothe user, and the speaker may audibly provide the state information ofthe electronic device 400 to the user.

According to various embodiments, the electronic device 400 may includea plurality of cameras. For example, the electronic device 400 mayinclude a first camera 421 disposed on the top face 4001 of the housing410 and a plurality of second cameras 422 disposed on the side face4002. The first camera 421 may be disposed substantially at the centerof the top face 4001 of the electronic device 400 so as to capture anupward view of the electronic device 400. The side cameras 422 may bemounted along the side face 4002 of the electronic device 400 in anysuitable number and configuration (or an arrangement) that is capable ofcapturing all views along the horizontal face of the electronic device400. According to one embodiment, the electronic device 400 may providean omnidirectional image (or a full 360° view) of two-dimensional (2D)and/or 3D using the images captured through the first camera 421 and thesecond cameras 422.

FIG. 5 is an exploded perspective view of an electronic device accordingto various embodiments of the disclosure. An electronic device 500 ofFIG. 5 may be the same as or similar to the electronic device 200 or 400of FIGS. 2 and 4 in terms of at least one of the components, andredundant descriptions are omitted below.

Referring to FIG. 5, the electronic device 500 may include an upperhousing 510, a lower housing 520, a printed circuit board (PCB) 530, aplurality of cameras 540, a heat sink 550, and a battery 560.

According to one embodiment, the upper housing 510 and the lower housing520 define an inner space, in which the various components of theelectronic device 500 may be mounted, and the external appearance of theelectronic device 500. For example, the upper housing 510 maysubstantially define the greater part of the top face (e.g., the topface 4001 in FIG. 4) of the electronic device 500 and the lower housing510 may substantially define the greater part of the bottom face (e.g.,the bottom face 4003 in FIG. 4) of the electronic device 500. At least aportion of each of the upper housing 510 and the lower housing 520 has acurved shape and together define the side face of the electronic device500 (e.g., the side face 4002 in FIG. 4). However, the embodiments arenot limited thereto and the respective housings (the upper housing 510and/or the lower housing 520) of the electronic device 500 may have anyarbitrarily proper shape for the reasons of design in consideration ofaesthetic satisfaction and/or a function. According to anotherembodiment, the electronic device 500 may further include a separatehousing for defining a side face (e.g., the side face 4002 in FIG. 4).The upper housing 510 and the lower housing 520 may be integrally formedwith each other, or may be separately formed and assembled.

According to one embodiment, the PCB 530, the plurality of cameras 540,the heat sink 550, and the battery 560 may be disposed in the innerspace between the upper housing 510 and the lower housing 520.

On the PCB 530, a processor, a memory, and/or an interface may bemounted (or arranged). A processor may include one or more of, forexample, a CPU, at least one graphic processor, an ISP, a sensor hubprocessor, or a CP. The memory may include, for example, a volatilememory or a non-volatile memory. The interface may include, for example,an HDMI, a USB interface, an SD card interface, and/or an audiointerface. The interface may electrically or physically connect, forexample, the electronic device 500 to an external electronic device, andmay include a USB connector, an SD card/an MMC connector, or an audioconnector.

The plurality of cameras 540 may include a top camera 541 and aplurality of side cameras 542. The top camera 541 may be disposed tocapture the upward FOV of the electronic device 500 through the top faceof the electronic device 500. The plurality of side cameras 542 may bearranged along the edge or periphery of the electronic device 500according to a predetermined rule. The plurality of side cameras 542 maybe disposed such that the optical axis of each side camera is directedto the side face of the electronic device 500. For example, theplurality of side cameras 542 may be arranged on the PCB 430 such thatthe optical axis of each side camera is parallel to the plane of thePCB. The plurality of side cameras 542 may be arranged such that all ofthe optical axes thereof are in the same plane. Thus, the plurality ofside cameras 542 are capable of capturing images in all directions alongthe horizontal face of the electronic device 500. The optical axes ofthe plurality of side cameras 542 and the top camera 541 may beorthogonal to each other. According to one embodiment, the top camera541 may be fixedly coupled to the upper housing 510 and/or the PCB 530.According to one embodiment, the plurality of cameras 540 may be stablymounted by the structural support of the housings 510 and 520. Theplurality of cameras 540 may be electrically connected to at least oneprocessor disposed on the PCB 530. According to one embodiment, theplurality of side cameras 542 may be fixedly coupled or connected to theupper housing 510, the lower housing 520, and/or the PCB 530. Accordingto one embodiment, the top camera 541 may be connected or fixedlycoupled to approximately the center of the first face 531 of the PCB530, and the plurality of side cameras 542 may be fixedly coupled orconnected in the state of being arranged along the edge or periphery ofthe second face 532 of the PCB 530, which is opposite the first face531. However, embodiments are not limited thereto, and the plurality ofcameras 540 may be coupled to the first face 531 and/or the second face532 of the PCB 530 in any suitable configuration.

The heat sink 550 is capable of cooling the heat of the electronicdevice 500 by receiving heat from various heat generation components asheat sources included in the electronic device 500 and dissipating theheat to the air. The heat sink 550 may be made of a material having ahigh thermal conductivity, such as copper or aluminum. According to oneembodiment, the heat sink 550 may be configured to receive heat by beingin contact with a processor or memory mounted on the PCB 530. Accordingto another embodiment, the electronic device 500 may further include aseparate device for heat dissipation, such as a heat pipe or a cooler.

The battery 560 is a device for supplying power to at least onecomponent of the electronic device 500 and may include, for example, anon-rechargeable primary battery, a rechargeable secondary battery, or afuel cell. The battery 560 may be disposed under the PCB 530, forexample. As another example, the battery 560 may be disposed onsubstantially the same plane. The battery 560 may be disposed integrallywithin the electronic device 500, or may be configured to be detachablefrom the electronic device 500.

According to some embodiments, the electronic device 500 may furtherinclude a plurality of microphones (not illustrated). The plurality ofmicrophones may be configured to receive audio associated with at leastone of images acquired through the plurality of cameras 420.

FIG. 6 shows the FOV of a camera according to various embodiments of thedisclosure. The following description of the camera 600 illustrated inFIG. 6 below may be a description of each of the plurality of cameras540 described above.

Referring to FIG. 6, the camera 600 may include an image sensor 610configured to capture a series of images as unique photographic imagesor a video image. For example, the camera 600 may include a CCD imagesensor or a CMOS active pixel image sensor.

In various embodiments, the image sensor 610 of the camera 600 may havean aspect ratio of approximately 16:9, 4:3, or 3:2, or any othersuitable aspect ratio. The aspect ratio may be a ratio of the width tothe height of the sensor. According to various embodiments, the imagesensor 610 may have a width longer than the height thereof. In otherembodiments, the image sensor 610 may have height longer than the widththereof. According to various embodiments, the width and height of theimage sensor 610 may be expressed in the form of the number of pixels ontwo axes of the image sensor 610. For example, the image sensor 610 mayhave a width or height of 500 to 8000 pixels. As another example, animage sensor 610 having a width of 1920 pixels and a height of 1080pixels can be said to have an aspect ratio of 16:9.

According to various embodiments, the camera 600 may include a lens orlens assembly that collects incoming light and focuses the collectedlight to the focal area of the image sensor 610. The lens or lensassembly of the camera 600 may include a fisheye lens, a wide-anglelens, and a telephoto lens having various FOVs based on various focallengths.

According to various embodiments, the camera 600 may have an FOV that isat least partially based on the position or focal length of the camera600, or a magnification of the lens assembly and the position or size ofthe image sensor 610. In various embodiments, the FOV of the camera 600may indicate a horizontal, vertical, or diagonal range of a specificscene that is capable of being captured through the camera 600. Objects(or subjects) inside the FOV of the camera 600 may be captured by theimage sensor 610 of the camera 600 and objects outside the FOV may notappear on the image sensor 610. In various embodiments, the FOV may bereferred to as an AOV.

In various embodiments, the FOV or AOV may indicate an angular range ofa specific scene that can be captured (or imaged) by the camera 600. Forexample, the camera 600 may have a horizontal FOV (FOV_(H)) and avertical FOV (FOV_(V)) that are oriented approximately perpendicular toeach other. For example, the camera 600 may have an FOV_(H) in the rangeof 30 degrees to 100 degrees and a FOV_(V) in the range of 90 degrees to200 degrees. In various embodiments, the FOV_(H) of the camera 600 maybe wider than the FOV_(V) of the camera 600. For example, the camera 600may have an FOV_(V) in the range of 30 degrees to 80 degrees and aFOV_(H) in the range of 90 degrees to 200 degrees. In variousembodiments, the camera 600 having different FOV_(H) and FOV_(V) maycorrespond to the aspect ratio of the image sensor 610. Hereinafter,descriptions will be made assuming specific cameras each having aspecific FOV, but an electronic device according to various embodiments(e.g., the electronic device 400 in FIG. 4) may include any suitableimage sensors and any suitable lenses.

FIG. 7 illustrates a stereoscopic pair 700 of cameras according tovarious embodiments of the disclosure.

The stereoscopic pair 700 according to various embodiments may includetwo cameras, referred to as a left camera 710L and a right camera 710R,respectively. The left camera 710L and the right camera 710R are capableof acquiring (or capturing) images corresponding to the left and righteyes of a person, respectively.

According to one embodiment, each of the left camera 710L and the rightcamera 710R of the stereoscopic pair 700 may have an orientation 711 (oroptical axis) corresponding to the pointing direction or angle thereof.In one embodiment, the orientation 711 may be represented by a lineoriented to the center of the FOV of the camera 710. In one embodiment,the orientation 711 of the camera 710 may be oriented substantiallyperpendicular to the camera 710 and may be oriented in a directionapproximately orthogonal to the surface of the camera lens assembly orimage sensor. Alternatively, the orientation 711 may be the same as theoptical axis (or the central axis) of the camera lens. For example, theorientation 711 may be oriented in a direction generally orthogonal toan axis 712 corresponding to the line between cameras 710L and 710R ofthe stereoscopic pair 700. Referring to FIG. 7, each of the orientation711L of the left camera 710L and the orientation 711R of the rightcamera 710R is approximately orthogonal to the axis 712, and may meanthe optical axis of the FOV_(H) of each of the cameras 710L and 710R.The orientations 711L and 711R may be horizontal to each other. In otherwords, the FOV_(H) of the orientation 711L and the FOV_(H) of theorientation 711R may be in substantially the same face. The orientations711L and 711R may be substantially parallel to each other. In otherwords, the left camera 710L and the right camera 710R may correspond tocameras oriented in the same direction, and these cameras 710L and 710Rmay be defined as having the same orientation.

According to various embodiments, the left camera 710L and the rightcamera 710R may have orientations which are not parallel to each other,i.e. have a predetermined included (non-zero) angle therebetween. Forexample, the left camera 710L and the right camera 710R, which have thesame orientation, may have orientations 711L and 711R directed toward oraway from each other with ±0.1°, ±0.5°, ±1°, ±3°, or any appropriateangle value. Although an embodiment of the disclosure will now bedescribed on the assumption of a specific stereoscopic pair havingorientations pointing in the same direction, the electronic device(e.g., the electronic device 400) of the disclosure includes anystereoscopic pairs having any suitable orientations.

According to various embodiments, the stereoscopic pair 700 may have apredetermined spaced distance between the left camera 710L and the rightcamera 710R. The distance may be referred to as inter-camera spacing(ICS). Here, the ICS may be measured based on two points ofcorresponding to the left and right cameras 710L and 710R orspecifications of the left and right cameras 710L and 710R. For example,the ICS may correspond to the distance between the midpoints of the twocameras 710, the distance between the longitudinal axes of the twocameras 710, or the distance between the orientations 711 of the twocameras 710. According to one embodiment, the cameras 710L and 710R ofthe stereoscopic pair 700 may be spaced apart from each other by the ICSalong the axis 712, which corresponds to the line, which connects thecameras 710L and 710R and is generally perpendicular to the orientations711L and 711R.

According to one embodiment, the ICS may correspond to an approximateaverage distance between both pupils of a human or an inter-pupillarydistance (IPD). The stereoscopic pair 700 may have an ICS of 6 cm to 11cm. Corresponding to the approximate average IPD of a human being about6.5 cm, the stereoscopic pair 700 according to various embodiments maybe assumed to have an ICS of 6 cm to 7 cm. However, the embodiment isnot limited thereto, and the stereoscopic pair may have an ICS that islarger or smaller than the average IPD. An image captured using such astereoscopic pair having a larger ICS value is capable of providing aviewer with an image having an improved 3D characteristic whenreproduced. According to one embodiment, the stereoscopic pair may havean ICS of any suitable length designed according to factors such as thesize of an entire imaging device, or the FOV of a camera lens.

FIG. 8 illustrates a portion of a plan view of a camera arrangement of acamera system according to various embodiments of the disclosure.

Referring to FIG. 8, the camera system 800 includes a plurality ofn^(th) camera pairs 810 (or stereoscopic pairs) each constituted with aleft camera 811-L_(n) and a right camera 811-R_(n). For example, a firstleft camera 811-L₁ and a first right camera 811-R₁ may constitute afirst camera pair 810-1, and a second left camera 811-L₂ and a secondright camera 811-L₂ may constitute a second camera pair 810-2. Accordingto one embodiment, the camera system 800 may further include additionalcamera pairs such as a n^(th) camera pair 810-n.

According to various embodiments, respective cameras 811 may be locatedon a horizontal face or on the same face. For example, the cameras 811of the camera system 800 may be arranged along a rim (or an edge) in theform of a straight line, a curve, an ellipse (or a portion of anellipse), a circle (or a portion of a circle), or any suitable shape (aportion of the shape). According to one embodiment, the cameras 811 ofthe camera system 800 may be arranged along the edge or periphery of aPCB (e.g., the PCB 530 of FIG. 5) having a specific shape under apredetermined rule. Referring to FIG. 8, in one embodiment, the camerasystem 800 having cameras 811 arranged along a circle (dashed line) maybe configured to capture images over a panoramic view of 360 degrees (ora cylindrical side view). For example, the cameras 811 may be orientedtowards the side face of the camera system 800 (or the electronicdevice). Respective cameras 811 of the camera system 800 may be locatedon the same face and each of the cameras 811 may have an FOV_(H) that isoriented along the same face and an FOV_(V) that is oriented to beperpendicular to the horizontal face. In other words, each of thecameras 811 of the camera system 800 may be located on the same face andthe orientation 812 of each of the cameras 811 may also be located onthe same face. The cameras 811 may be arranged so as to be substantiallyparallel to an arrangement face (e.g., the first face 531 in FIG. 5) onthe PCB on which the cameras 811 are mounted. For example, the cameras811 including the first left camera 811-L₁ and the first right camera811-R₁, the second left camera 811-L₂, the second right camera 811-R₂,the n^(th) left camera 811-L_(n), and the n^(th) right camera 811-R_(n)may be located along a circle (dashed line) on the same face, and theorientations of respective cameras 811 may also be located on the sameface of the cameras 811. That is, the orientations 812 of respectivecameras 811 (e.g., orientations 812L1 and 812Rn of respective cameras811-L1 and 811-Rn) may indicate the horizontal directions of the sameface.

According to one embodiment, the camera system 800 may include aplurality of camera pairs 810 interleaved with each other. For example,one camera of the first camera pair 810-1 may be located between thecameras of the second camera pair 810-2 adjacent thereto. As anotherexample, one camera of the second camera pairs 810-2 may also be locatedbetween the cameras of the first camera pair 810-1. In one embodiment,camera pairs, which are located adjacent to each other or in contactwith each other, may mean camera pairs positioned side by side, or maymean camera pairs in which one camera of one camera pair is disposed tobe located between the two cameras another camera pair. In other words,one camera of the camera pair 810-2 may be interleaved between the twocameras of the camera pairs 810-1 and vice versa. For example, as thecamera pairs are interleaved with each other, the second right camera811-R₂ is located between the first cameras 811-L₁ and 811-R₁, and thefirst left camera 811-L₁ may be located between the second cameras811-L₂ and 811-R₂.

According to various embodiments, the cameras 811 of each camera pair810 may be uniformly arranged such that adjacent pairs of cameras 810may be oriented with an angle θ with respect to each other. According toone embodiment, the angle θ may correspond to the difference inorientation or the angular spacing of respective camera pairs 810 thatare adjacent to each other. The first camera pair 810-1 in which thefirst left camera 811-L₁ is included and the second camera pair 810-2 inwhich the second right camera 811-2 may be located to have a differenceof angle θ. According to one embodiment, the angle θ between adjacentcamera pairs Ln-Rn may be approximately the same for adjacent camerapairs 810 of camera system 800. For example, respective adjacent camerapairs 810 of the camera system 800 may be oriented with an angle of 26degrees, 30 degrees, 36 degrees, 45 degrees, 60 degrees, 90 degrees, orany suitable angle with respect to each other. According to oneembodiment, in a camera system 800 having camera pairs 810 arrangedalong a circle at m uniform intervals, the angle θ between respectiveadjacent camera pairs may be expressed as θ≈360 degrees/m. For example,in a camera system including eight camera pairs arranged along a circleat uniform intervals with m=8, the angle θ may be approximately 360degrees/8=45 degrees. As another example, in a camera system includingtwelve camera pairs arranged along a circle at uniform intervals withm=12, the angle θ may be approximately 360 degrees/12=30 degrees.

FIG. 9 is a side view of a camera system according to variousembodiments of the disclosure.

According to one embodiment, a camera system 900 may include sidecameras 910 arranged along the edge or periphery of the camera system900, and a top camera 910T that is oriented upward with respect to thecamera system 900. The side cameras 910 are capable of capturing acylindrical side view and the top camera 910T is capable of capturing atop view that forms a roof on the cylindrical side view. The cylindricalside view and the top view may be combined so as to provide the userwith an “omnidirectional image” or a “full 360° view” of 2D and/or 3D.According to another embodiment, the camera system 900 may furtherinclude a bottom camera (not illustrated) that is oriented downward.According to another embodiment, the camera system 900 may furtherinclude at least two top cameras 910T (e.g., a left top camera and aright top camera capable of configuring a stereoscopic pair). Accordingto another embodiment, the camera system 900 may be configured with sidecameras 910 having an FOV_(v) of 180° or more without a top camera 910_(T) and/or a bottom camera, and thus it is possible to capture a full360° view only using the side cameras 910.

Referring to FIG. 9, the camera system 900 may include side cameras 910arranged along the periphery of the camera system 900 and a top camera910T located at the center. Each of the side cameras 910 and the topcamera 910T may be at least partially the same as or similar to thecamera 600 illustrated in FIG. 6. The side cameras 910 may be the sameas or similar to the cameras (e.g., the cameras 811) illustrated in FIG.8 and may be arranged to form stereoscopic pairs on the same face asdescribed above. According to one embodiment, the top camera 910T may bedisposed to be substantially orthogonal to the side cameras 910. Theorientations 911 of the side cameras 910 may be parallel to thehorizontal face on which the side cameras 910 are arranged. Theorientation 911T of the top camera 910T may be substantially orthogonalto the orientations 911 of the side cameras 910. However, the embodimentis not limited thereto, and the camera system 900 according to variousembodiments may have any suitable arrangement of side cameras 910 andany suitable configuration and arrangement of a top camera 910T.

According to one embodiment, the top camera 910T may have a FOV_(T) thatat least partially overlaps or shares the FOV_(V) of the one or moreside cameras 910. According to one embodiment, the top camera 910T mayhave an edge portion of the image captured by the top camera 910T (e.g.,a top view) and a top overlap 921 between the top portions of the imagescaptured by the side cameras 910 (e.g., the cylindrical side views). Thetop overlap 921 may overlap 10% to 30% of the FOV_(V) of the sidecameras 910 and/or the FOV_(T) of the FOV_(H) of the top camera 910T.According to one embodiment, the top camera 910T may have a relativelylarger FOV than that of the side cameras 910. For example, the FOV_(T)of the top camera 910T may have 140° to 185°.

FIG. 10 illustrates a set of overlapped images captured by the camerasystem according to various embodiments of the disclosure.

In the embodiment of FIG. 10, a camera system 1000 may include aplurality of left cameras 1011 and a plurality of right cameras 1012,which constitute stereoscopic pairs, respectively, and at least one topcamera 1013. The side cameras 1011 and 1012 may be the same or similarto the cameras illustrated in FIG. 8 (e.g., the side cameras 811) andmay be disposed on the same face. The top camera 1013 may be the same asor similar to the top camera 910T illustrated in FIG. 9, and the sidecameras 1011 and 1012 may be disposed to be oriented to be orthogonal tothe side cameras 1011 and 1012. However, the embodiment is not limitedthereto, and the camera system 1000 according to various embodiments mayhave any suitable configuration and arrangement of side cameras and atop camera.

Referring to FIG. 10, the camera system 1000 according to variousembodiments may have eight stereoscopic pairs, and thus may includeeight left cameras 1011 and eight right cameras 1012. Left camera imagesIL can be captured or obtained from the left cameras 1011. Right cameraimages IR can be captured or obtained from the right cameras 1012. A topimage ITOP can be captured or obtained from the top camera 1013.According to one embodiment, the camera system 1000 may combine the leftcamera images IL and the top image ITOP so as to provide a 2Domnidirectional image (or a 2D full 360° view). According to anotherembodiment, the camera system 1000 may combine the right camera imagesIR and the top image ITOP so as to provide a 2D omnidirectional image.According to another embodiment, the left camera images IL are imagescorresponding to the left eye of a person, and the right camera imagesIR may be images corresponding to the right eye of a person. Thus, thecamera system 1000 may provide a 3D omnidirectional image (or a 3D full360° view) using the left camera images IL, the right camera images IR,and the top image ITOP. The camera system 1000 may use only any one ofthe left camera images IL and the right camera images IR in order toprovide a 2D omnidirectional image.

According to one embodiment, the left cameras 1011 and the right cameras1012 included in the camera system 1000 may be arranged in a paired andinterleaved manner, as described above. Thus, the images captured fromrespective cameras may partially overlap each other so as to generatethe left camera images IL and the right camera images IR.

According to one embodiment, the left camera images IL may include firstto eighth left camera images IL-1 to IL-8. Overlapped areas 1020-Ln(e.g. 1020-L1 to 1020-L9) may correspond to overlapped or sharedportions of the images IL of neighboring left cameras 1011. For example,the first overlapped area 1020-L1 may be an overlapped area of the firstleft camera image IL-1 and the second left camera image IL-2, and theeighth overlapped area 1020-L8 may be an overlapped area of the firstleft camera image IL-1 and the eighth left camera image IL-8. Similarly,the right camera images IR may include first to eighth right cameraimages IR-1 to IR-8. Overlapped areas 1020-Rn (e.g. 1020-R1 to 1020-R9)may correspond to overlapped or shared portions of the images IR ofneighboring right cameras 1011. An overlapped area 1020-T of the topimage ITOP may partially overlap the top portions of the side cameraimages, e.g., the upper portions of the left camera images IL and/or theright camera images IR. The overlapped area 1020-T may correspond to theedge area of the top image ITOP. According to one embodiment, theoverlapped area 1020-T may be used to stitch the top image ITOP with theimages obtained from one or more side cameras 1011 and 1012.

FIGS. 11A and 11B are plan views illustrating an example of a PCBaccording to various embodiments of the disclosure.

Referring to FIGS. 11A and 11B, a camera system 1100 may include a PCB1110 and a plurality of cameras 1110 that are uniformly disposed alongthe edges or periphery of the PCB 1110. The PCB 1110 of FIGS. 11A and11B may be at least partially identical or similar to the PCB 530illustrated in FIG. 5, and the camera system 1100 configured with theplurality of cameras 1120 may be at least partially identical or similarto the camera systems 800, 900, and 1000 illustrated in FIGS. 8 to 10.

Referring to FIGS. 11A and 11B, the first to sixteenth cameras 1120-1 to1120-16 according to one embodiment may be sequentially arranged in aclockwise direction along the periphery of the PCB 1100. The first tosixteenth cameras 1120-1 to 1120-16 may be disposed on the same face ofthe PCB 1100. The orientation (e.g., the FOV_(H)) of each of the firstto the sixteenth cameras 1120-1 to 1120-16 may be parallel to themounting face of the PCB 1100 (e.g., the first face 531 in FIG. 5). Thefirst to sixteenth cameras 1120-1 to 1120-16 may be configured to formrespective eight stereoscopic pairs. For example, the first camera1120-1 and the fourth camera 1120-4 may form a first stereoscopic pair1130. Accordingly, the first camera 1120-1 may be referred to as a firstleft camera, and the fourth camera 1120-4 may be referred to as a firstright camera. Thus, in the embodiment of FIG. 8, the plurality ofcameras 1110 (i.e., the first to sixteenth cameras 1120-1 to 1120-16)are include a left camera set of eight cameras and a right camera set ofeight cameras that form eight stereoscopic pairs. For example, the leftcamera set may include the first camera 1120-1, the third camera 1120-3,the fifth camera 1120-5, the seventh camera 1120-7, the ninth camera1120-9, the eleventh camera 1120-11, the thirteenth camera 1120-13, andthe fifteenth camera 1120-15. In addition, the right camera set mayinclude the second camera 1120-2, the fourth camera 1120-4, the sixthcamera 1120-6, the eighth camera 1120-8, the tenth camera 1120-10, thetwelfth camera 1120-12, the fourteenth camera 1120-14, and the sixteenthcamera 1120-16. According to one embodiment, the eight cameras of theleft camera set and the eight cameras of the right camera set may beinterleaved with each other. For example, the first camera 1120-1corresponding to the first left camera may be arranged adjacent to thesecond camera 1120-2 and the sixteenth camera 1120-16 between the secondcamera 1120-2 corresponding to the first right camera and the sixteenthcamera 1120-16 corresponding to the eighth right camera.

According to one embodiment, the PCB 1110 may be configured such thatthe plurality of cameras 1120 do not protrude beyond the outermost edge1111 (or a housing (e.g., the housing 410 of FIG. 4)) of the PCB 1110.For example, the PCB 1110 may include at least one protrusion 1113formed along the periphery thereof. The plurality of cameras 1120 areoptical devices that are sensitive to an external impact, and thus, inthe plurality of cameras 1120, malfunction or an error due to anexternal with respect to the camera system 1100) (or the electronicdevice), or quality deterioration of captured images may be caused dueto scratches or the like on the lenses. Accordingly, the PCB 1110 has ashape having a configuration or arrangement in which the plurality ofcameras 1120 are disposed inside the outermost portion 1111 thereofwithout protruding from the outermost portion 1111, so that the cameras1120 can be protected from external shocks.

The camera system 1100 according to various embodiments of thedisclosure will be described in one aspect with reference to FIG. 11A.According to one embodiment, the plurality of cameras 1110 may beoperatively and electrically connected to a plurality of processors 1140and 1150, respectively. Each of the plurality of processors 1140 and1150 is capable of encoding (or image-processing) an electricalbrightness signal obtained from a camera (or an image sensor) connectedthereto into a digital image. Thus, each of the plurality of processors1140 and 1150 may be referred to as an image processor. According to oneembodiment, each of the plurality of processors 1140 and 1150 mayinclude a field programmable gate array (FPGA), and may be operativelyand electrically connected to each of the plurality of cameras 1110through the FPGA.

For example, the left camera set may be connected to the left processor1140. For example, the first camera 1120-1, the third camera 1120-3, thefifth camera 1120-5, the seventh camera 1120-7, the ninth camera 1120-9,the eleventh camera 1120-11, the thirteenth camera 1120-13, and thefifteenth camera 1120-15 may be connected to the left processor 1140.

For example, the right camera set may be connected to the rightprocessor 1150. For example, the second camera 1120-2, the fourth camera1120-4, the sixth camera 1120-6, the eighth camera 1120-8, the tenthcamera 1120-10, the twelfth camera 1120-12, the fourteenth camera1120-14, and the sixteenth camera 1120-16 may be connected to the rightprocessor 1150.

The plurality of electrical connections between the plurality of cameras1120 and processors 1140 and 1150 may be formed by a plurality ofconductive patterns formed on the PCB 1110. According to one embodiment,the PCB 1110 may be implemented as a multilayer PCB in order to preventinterference between the plurality of conductive patterns. According toanother embodiment, the plurality of electrical connections may also beformed of at least one or a combination of two or more of a conductivepattern formed on the PCB 1110, a flexible printed circuit board (FPCB),and wiring.

In the above-described embodiment, the electrical connection between theleft camera set and the left processor 1140 and the electricalconnection between the right camera set and the right processor 1150 maybe defined as a first configuration. With the first configuration, theleft processor 1140 may provide left camera images (e.g., left cameraimages IL in FIG. 10) based on images acquired from the left camera set,and the right processor 1150 may provide right camera images (e.g., theright camera images IR in FIG. 10) based on the images acquired from theright camera set. As an example, the camera system 1100 may provide a 2Domnidirectional image based on the left camera images, through controland/or power supply with respect to the left processor 1140. As anotherexample, the camera system 1100 may provide a 2D omnidirectional imagebased on the right camera images, through control and/or power supplywith respect to the right processor 1150. As still another example, thecamera system 1100 may provide a 3D omnidirectional image based on theleft and right camera images, through control and/or power supply withrespect to the left processor 1140 and the right processor 150.Accordingly, according various embodiments of the disclosure, the camerasystem 1100 may provide a 2D omnidirectional image through controland/or power supply to any one of the left processor 1140 and the rightprocessor 1150.

Processors (e.g., the processors 1140 and 1150) according to variousembodiments of the disclosure may include a plurality of processors. Forexample, the left processors 1140 may be constituted with a first leftprocessor 1141 and a second left processor 1142, and the rightprocessors 1150 may be constituted with a first right processor 1151 anda second right processor 1152. According to one embodiment, each of theplurality of processors 1141, 1142, 1151, and 1152 may further includean FPGA. According to one embodiment, the first camera 1120-1, the thirdcamera 1120-3, the fifth camera 1120-5, and the seventh camera 1120-7may be electrically connected to the first left processor 1141. Theninth camera 1120-9, the eleventh camera 1120-11, the thirteenth camera1120-13, and the fifteenth camera 1120-15 may be electrically connectedto the second right processor 1142. In addition, the second camera1120-2, the fourth camera 1120-4, the sixth camera 1120-6, and theeighth camera 1120-8 may be electrically connected to the first rightprocessor 1151. The tenth camera 1120-10, the twelfth camera 1120-12,the fourteenth camera 1120-14, and the sixteenth camera 1120-16 may beelectrically connected to the second right processor 1152. The pluralityof electrical connections between the plurality of cameras 1120 andprocessors 1141, 1142, 1151, and 1152 may be formed by a plurality ofinterfaces (or signal lines or a conductive pattern) formed on the PCB1110. For example, the first left processor 1141 may be connected to aplurality of cameras (e.g., the cameras 1120-1, 1120-3, 1120-5, and1120-7) by first interfaces 1112-1 For example, the second leftprocessor 1142 may be connected to a plurality of cameras (e.g., thecameras 1120-9, 1120-11, 1120-13, and 1120-15) by second interfaces1112-2 For example, the first right processor 1151 may be connected to aplurality of cameras (e.g., the cameras 1120-2, 1120-4, 1120-6, and1120-8) by third interfaces 1112-3 For example, the second rightprocessor 1152 may be connected to a plurality of cameras (e.g., thecameras 1120-10, 1120-12, 1120-14, and 1120-16) by fourth interfaces1112-4.

According to an embodiment, the PCB 1110 may be implemented as amultilayer PCB in order to prevent interference between the plurality ofinterfaces. According to another embodiment, the electrical connectionsbetween the cameras and the processors may also be formed of at leastone or a combination of two or more of a conductive pattern formed onthe PCB 1110, an FPCB, and wiring.

In the above-described embodiment, the electrical connections betweenthe left camera set and the first and second left processors 1141 and1142 and the electrical connections between the right camera set and thefirst and second right processors 1151 and 1152 may be defined as asecond configuration. With the second configuration, the camera system1100 may provide a 2D or 3D omnidirectional image based on left cameraimages and/or right camera images, through control and/or power supplywith respect to at least one or a combination of two or more of the leftand right processors 1141, 1142, 1151, and 1152. In addition, the camerasystem 1100 may provide a 2D panoramic image through control and/orpower supply with respect to one of the left and right processors 1141,1142, 1151, and 1152.

According to the first and second configurations described above, eachof the plurality of cameras 1120 may be configured to be electricallyconnected to a functionally associated processor, rather than aprocessor disposed adjacent thereto on the PCB 1110. For example,assuming that the PCB 1110 is divided into quadrants, the first camera1120-1, the second camera 1120-2, the fifteenth camera 1120-15, and thesixteenth camera included in the second quadrant Q2 may be connected todifferent processors, respectively, rather than being connected to thenearest first left processor 1141. That is, the PCB 1110 may includeinterfaces to which the processors, with which the cameras 1120 arerespectively functionally associated, can be electrically connected,regardless of the complexity of the interfaces and hence difficulties indesign/process.

Accordingly, the camera system 1100 according to various embodiments ofthe disclosure may only require control with respect to an associatedprocessor (e.g., the processor 1141, 1142, 1151, or 1152) depending onthe type of an image (e.g., a 2D panoramic view, or a 2D or 3Domnidirectional image). That is, the camera system 1100, which includesconnection configurations (e.g., the first configuration and the secondconfiguration) between the plurality of cameras 1120 and the processors1140 and 1150 according to various embodiments of the disclosure, may beefficiently operated in terms of calculation for image processing andpower management.

However, the embodiment is not limited thereto, and the connectionsbetween the plurality of cameras 1120 and the processors may bereconfigured based on various design factors such the number of theplurality of cameras 1120, the type of images obtained from theplurality of cameras 1120, the number of processors, the arrangement ofthe processors, and the like.

Hereinafter, the camera system 1100 according to various embodiments ofthe disclosure will be described in another aspect with reference toFIG. 11B. According to one embodiment, the PCB 1110 may include aplurality of protrusions 1113 at regular intervals along thecircumference thereof. The plurality of cameras 1120 may be arranged tohave a pair of adjacent cameras in each of the areas between theprotrusions 1113. Each of the areas between the projections 1113 may bedefined by a concave portion 1114. For example, the first camera 1120-1and the second camera 1120-2 may be arranged in a first concave portion1114-1. The third camera 1120-3 and the fourth camera 1120-4 may bedisposed in a second concave portion 1114-2 adjacent to the firstconcave portion 1114-1. The fifth camera 1120-5 and the sixth camera1120-6 may be disposed in a third concave portion 1114-3 adjacent to thesecond concave portion 1114-2.

The first camera 1120-1 and the second camera 1120-2 may be arrangedsuch that the optical axes (or orientations) cross each other at aninterval of a specific angle (θ). In other words, the first camera1120-1 and the second camera 1120-2 may capture FOVs, substantiallyalmost all areas of which overlap each other, at different angles. Thefirst camera 1120-1 and the fourth camera 1120-4 may be arranged suchthat the optical axes thereof are substantially parallel to each other.The first camera 1120-1 and the fourth camera 1120-4 may constitute astereoscopic pair for acquiring images corresponding to the left eye andthe right eye, respectively. According to one embodiment, when thespecific angle (θ) is 45°, the optical axes of the first camera 1120-1and the fifth camera 1120-5 may be substantially orthogonal (90°) toeach other. The remaining sixth to sixteenth cameras 1120-6 to 1120-16may be disposed on the PCB 1110 according to the above-describedarrangement relationship.

According to one embodiment, the camera system 1100 may include aplurality of processors 1141, 1142, 1151, and 1152 disposed on the PCB1110. The plurality of processors may be disposed on one face of the PCB1110 together with the plurality of cameras 1120. According to oneembodiment, the first processor 1141 may be disposed on the PCB 1110 inan area adjacent to the first camera 1120-1 and the second camera1120-2. The second processor 1151 may be disposed on the PCB 1110 in anarea adjacent to the third camera 1120-3 and the fourth camera 1120-4.

According to an embodiment, the first camera 1120-1 may be electricallyconnected to the first processor 1141 and the fourth camera 1120-4 maybe electrically connected to the second processor 1151. The secondcamera 1120-2 may be electrically connected to the second processor1151, rather than to the adjacent first processor 1141 adjacent thereto.In addition, the third camera 1120-3 may be electrically connected tothe first processor 1141, rather than to the second processor 1151adjacent thereto. The fifth camera 1120-5 and the seventh camera 1120-7may be electrically connected to the first processor 1141, rather thanto the processors 1151 and 1152 adjacent thereto. For example, the firstprocessor 1141 may be connected to a plurality of cameras (e.g., thecameras 1120-1, 1120-3, 1120-5, and 1120-7) by first designatedinterfaces 1112-1 The second processor 1151 may be connected to aplurality of cameras (e.g., the cameras 1120-2, 1120-4, 1120-6, and1120-8) by second designated interfaces 1112-3 The third processor 1142may be connected to a plurality of cameras (e.g., the cameras 1120-9,1120-11, 1120-13, and 1120-15) by third designated interfaces 1112-2 Thefourth processor 1152 may be connected to a plurality of cameras (e.g.,the cameras 1120-10, 1120-12, 1120-14, and 1120-16) by fourth designatedinterfaces 1112-4.

Thus, the camera system 1100 according to various embodiments of thedisclosure is capable of obtaining a 2D panoramic view A-A′ merelythrough control with respect to the first processor 1141. The camerasystem 1100 is capable of obtaining a 3D panoramic view A-A′ merelythrough control with respect to the first processor 1141 and the secondprocessor 1142. The camera system 1100 is capable of obtaining a 2Domnidirectional view merely through control with respect to the firstprocessor 1141 and the fourth processor 1152. The camera system 1100 iscapable of obtaining a 3D omnidirectional view through control withrespect to all the processors 1141, 1142, 1151, and 1152. That is, eachof the plurality of cameras 1120 may be configured to be electricallyconnected to a functionally associated processor, rather than to aprocessor disposed the PCB 1110 adjacent thereto.

According to an embodiment, the PCB 1110 may be implemented as amultilayer PCB in order to prevent interference between the plurality ofinterfaces. According to another embodiment, the electrical connectionsbetween the cameras and the processors may also be formed of at leastone or a combination of two or more of a conductive pattern formed onthe PCB 1110, an FPCB, and wiring. That is, the PCB 1110 may includeinterfaces to which the processors, with which the cameras 1120 arerespectively functionally associated, can be electrically connected,regardless of the complexity of the interfaces and hence difficulties indesign/process.

FIG. 12 is a plan view illustrating another example of a PCB accordingto various embodiments of the disclosure.

Referring to FIG. 12, a camera system 1200 may include a PCB 1210 and aprocessor 1220 mounted on the PCB 1210. The PCB 1110 of FIG. 12 may beat least partially the same or similar to the PCB 530 illustrated inFIG. 5.

According to one embodiment, a top camera 1230 included in the camerasystem 1200 may be operatively and electrically connected to theprocessor 1220. The processor 1220 is capable of encoding (orimage-processing) an electrical brightness signal obtained from the topcamera 1230 connected thereto into a digital image. Thus, the processor1220 may be referred to as an image processor. According to oneembodiment, the processor 1220 may include an FPGA, and may beoperatively and electrically connected to the top camera 1230 throughthe FPGA.

According to one embodiment, the processor 1220 in the camera system1200 may operate as a main processor (e.g., the processor 310 of FIG. 3)in addition to processing images obtained from the top camera 1230. Theprocessor 1220 may control one or more other components (e.g., ahardware or software component) of the electronic device (e.g., theapparatus 300 of FIG. 3), which are connected to the processor 1220 andmay perform various data processing and arithmetic operations by drivingsoftware (e.g., a program or an instruction word). For example, theprocessor 1220 may receive image data, acquired from other cameras(e.g., the cameras 1120 of FIGS. 11A and 11B), from other processors(e.g., the processors 1141, 1142, 1151, and 1152 of FIGS. 11A and 11B)and may combine the image data obtained from the top camera 1230 to theimage data acquired from the other cameras. That is, the processor 1220is capable of collectively operating the image data acquired by thecamera system 1200. However, the embodiment is not limited thereto, andthe number of the processors 1220 and the other processors (e.g., theprocessors 1141, 1142, 1151, and 1152 in FIGS. 11A and 11B) and thearithmetic processing method may be suitably determined or configured.For example, the processor 1220 may receive image data acquired directlyfrom other cameras (e.g., the cameras 1120 of FIGS. 11A and 11B) and mayreceive image data acquired from the top camera 1230, and may integrateand process the image data. The configuration of the processors will bedescribed later in detail.

According to one embodiment, the processor 1220 may include at least onecommunication interface (e.g., the communication interface 340 of FIG.3). The processor 1220 may be connected to at least one of the otherprocessors (e.g., the processors 1141, 1142, 1151, and 1152 of FIGS. 11Aand 11B) using a communication interface for image data reception, ormay be connected to a communication interface for image datatransmission. According to one embodiment, connections between theprocessor 1220 and other processors may include at least one of a viahole, a conductive pattern, a wiring, and a cable formed in the PCB1210. The configuration in which the processor 1220 according to oneembodiment is connected to other processors and/or interfaces will bedescribed later in detail.

FIGS. 13A, 13B, and 13C illustrate examples of the arrangement structureof a plurality of cameras and a PCB according to various embodiments ofthe disclosure.

Referring to FIG. 13A, a camera system 1300 according to one embodimentmay include a double-sided PCB. A processor connected to a top camera1320 (or the top camera 541 in FIG. 5) may be mounted on the top face1311 of the PCB 1310. On the rear face 1312 of the PCB 1310, a pluralityof side cameras 1330 (or the cameras 542 of FIG. 5) may be disposedalong the periphery of the PCB 1310 and at least one processor connectedto the plurality of side cameras 1330 may be mounted. Here, the top face1311 of the PCB 1310 may be configured using the PCB 1210 illustrated inFIG. 12, and the bottom face 1312 may be configured using the PCB 1110illustrated in FIGS. 11A and 11B. Thus, the camera system 1300 may havea thickness reduction (slimming) effect of the camera system 1300 byincluding a double-sided PCB.

Referring to FIG. 13B, a camera system 1300 according to one embodimentmay include a plurality of single-sided PCBs. For example, the camerasystem 1300 may include a first PCB 1310 and a second PCB 1340 thatforms a duplex with the first PCB 1310. A processor connected to the topcamera 1320 may be mounted on the second PCB 1340. On the first PCB1310, a plurality of side cameras 1330 may be disposed along theperiphery of the second PCB 1310 and at least one processor connected tothe plurality of side cameras 1330 may be mounted. Here, the second PCB1340 may be configured using the PCB 1210 illustrated in FIG. 12, andthe first PCB 1310 may be configured using the PCB 1110 illustrated inFIGS. 11A and 11B.

Referring to FIG. 13C, the camera system 1300 according to oneembodiment may include a PCB 1310 and a support 1350 disposed on the PCB1310. The plurality of side cameras 1330 may be disposed along theperiphery of the PCB 1310 and the top camera 1320 may be disposed on thesupport 1350 on the PCB 1310. The support 1350 may be fixedly coupled tothe top camera 1320. The support 1350 may have any suitable structuresuch that the top camera 1320 can be stably fixed. The PCB 1310 may bemounted with at least one processor connected to the top camera 1320 andthe plurality of side cameras 1330.

Without being limited to the embodiment illustrated in FIGS. 13A to 13C,the PCB may have any suitable structure on which a top camera, aplurality of side cameras, and at least one processor connected to thecameras can be mounted.

FIG. 14 illustrates an example of the functional configuration of anapparatus that controls power according to various embodiments of thedisclosure. This functional configuration may be included in theapparatus 300 illustrated in FIG. 3.

Referring to FIG. 14, the apparatus 300 may include a first processor310-1, a second processor 310-2, a third processor 310-3, a first camera330-1, a second camera 330-2, a first PMIC 350-1, a second PMIC 350-2,and a third PMIC 350-3.

The first processor 310-1 may control the overall operation of theapparatus 300. The first processor 310-1 may control the overalloperation of the apparatus 300 by being operatively connected to theother components (e.g., the second processor 310-2, the third processor310-3, the second PMIC 350-2, and the third PMIC 350-2).

The second processor 310-2 may be operatively connected to the firstcamera 330-1. The second processor 310-2 may acquire an image throughthe first camera 330-1. The second processor 310-2 may encode theacquired image. The second processor 310-2 may generate the encoded databy encoding the acquired image. The second processor 310-2 may providethe encoded data to the first processor 310-1.

The second processor 310-2 may be operatively connected to the secondPMIC 350-2. The second processor 310-2 may operate based on the powerprovided from the second PMIC 350-2.

The third processor 310-3 may be operatively connected to the secondcamera 330-2. The third processor 310-3 may acquire an image through thesecond camera 330-2. The third processor 310-3 may encode the acquiredimage. The third processor 310-3 may generate encoded data by encodingthe acquired image. The third processor 310-3 may provide the encodeddata to the first processor 310-1.

The third processor 310-3 may be operatively connected to the third PMIC350-3. The third processor 310-3 may operate based on the power providedfrom the third PMIC 350-3.

Each of the first processor 310-1, the second processor 310-2, and thethird processor 310-3 may correspond to the processor 310 illustrated inFIG. 3.

The first camera 330-1 may be operatively connected to the secondprocessor 310-2. The first camera 330-1 may be configured to be orientedin a first direction. The first camera 330-1 may have a first opticalaxis (e.g., the orientation 711L in FIG. 7). The first camera 330-1 mayhave a first FOV (or a first AOV). Optical data associated with theimage acquired through the first camera 330-1 may be provided to thesecond processor 310-2.

The second camera 330-2 may be operatively connected to the thirdprocessor 310-3. The second camera 330-2 may be configured to beoriented in a second direction corresponding to the first direction. Thesecond camera 330-2 may have a second optical axis (e.g., theorientation 711R in FIG. 7). The second camera 330-2 may have a secondFOV, which partially overlaps the first FOV. Since the second camera330-2 is configured to be oriented in the second direction correspondingto the first direction, and has the second FOV, which partially overlapsthe first FOV, the second camera 330-2 may perform a function, which isthe same as the left eye of a person relative to the first camera 330-1.In other words, the first camera 330-1 may perform a function, which isthe same as the right eye of a person relative to the second camera330-2. In other words, when only the images acquired through the secondcamera 330-2 are used, the final image may be a 2D image, and when boththe images acquired through the first camera and the images acquiredthrough the second camera are used, the final image may be a 3D image.Optical data associated with the image acquired through the secondcamera 330-2 may be provided to the third processor 310-3.

Each of the first camera 330-1 and the second camera 330-2 maycorrespond to the camera 330 illustrated in FIG. 3. Each of the firstcamera 330-1 and the second camera 330-2 may be constituted with aplurality of groups or sets of cameras.

The first PMIC 350-1 may be configured to provide power to the firstprocessor 310-1. The second PMIC 350-2 may be configured to providepower to the second processor 310-2. The third PMIC 350-3 may beconfigured to provide power to the third processor 310-3. Each of thefirst PMIC 350-1, the second PMIC 350-2, and the third PMIC 350-3 maycorrespond to the PMIC 350 illustrated in FIG. 3.

In various embodiments, the first processor 310-1 may control the secondPMIC 350-2 based on the mode (or the operation mode) of the apparatus.The modes of the apparatus may be changed according to the attribute ofan image to be generated. For example, the mode of the apparatus mayinclude a first mode for generating a 2D image, and a second mode forgenerating a 3D image. The final image may include an omnidirectionalimage, a panoramic image, and the like. In various embodiments, the modeof the apparatus may be changed based on a user input. For example, thefirst processor 310-1 may change the mode of the apparatus based on theuser input received through the input device 370 illustrated in FIG. 3.In various embodiments, the mode of the apparatus may be changed basedon the state of the battery included in the apparatus 300. For example,the first processor 310-1 may change the mode of the apparatus from thesecond mode to the first mode in response to confirming that theremaining amount of the battery is below the reference value. Thereference value may be a fixed value or a changeable value. When thereference value is configured with a changeable value, the referencevalue may be changed based on a user input or user selection.

When the apparatus 300 operates in the first mode, among the operationsof the first camera 330-1 and the second camera 330-2, the operation ofthe first camera 330-1 may not be required. In other words, when theapparatus 300 operates in the first mode, among the operations of thesecond processor 310-2 and the third processor 310-3, the operation ofthe second processor 310-2 may not be required. In various embodiments,the first processor 310-1 may interrupt or restrict power supply to thesecond processor 310-2 that controls the acquisition of an image throughthe first camera 330-1 based on the fact that the apparatus 300 operatesin the first mode. In order to interrupt the power supply, the firstprocessor 310-1 may send a first control signal to the second PMIC350-2. The second processor 310-2 for which power supply is interruptedmay be switched to a state in which booting is required to start (orresume) the operation. In various embodiments, the first processor 310-1may control the second PMIC 350-2 such that power lower than normalpower is supplied to the second processor 310-2 that controls theacquisition of an image through the first camera 330-1 based on the factthat the apparatus 300 operates in the first mode. The second processor310-2, which is supplied with the power lower than the normal power maybe switched to a state in which booting is not required to start theoperation. In other words, the second processor 310-2, which is suppliedwith power lower than the normal power, may be switched to a sleep state(or a standby state). In various embodiments, the first processor 310-1may resume power supply (or normal power supply) to the second processor310-2 that controls the acquisition of an image through the first camera330-1 based on the fact that the apparatus 300 operates in the secondmode. In order to resume the power supply, the first processor 310-1 maysend a second control signal to the second PMIC 350-2. When the power issupplied or supplied again, the second processor 310-2 may operate in anactivated state in which the second processor 310-2 is capable ofcontrolling the first camera 330-1 or capable of encoding an imageacquired through the first camera 330-1.

As described above, in an apparatus 300 according to variousembodiments, a processor (e.g., the third processor 310-3), connected toa camera (e.g., the second camera 330-2) for performing a functioncorresponding to one eye of a person among a plurality of cameras (e.g.,the first camera 330-1 and the second camera 330-2) included in a camerapair for performing functions corresponding to the both eyes of theperson, may be separated from a processor (e.g., the second processor310-2), connected to another camera (e.g., the first camera 330-1) forperforming a function corresponding to the other eye of the person amongthe plurality of cameras (e.g., the first camera 330-1 and the secondcamera 330-2) included in the camera pair for performing the functionscorresponding to the functions of the both eyes of the person. Due tothis separation, the apparatus 300 according to various embodiments mayindividually control the states of a plurality of processors (e.g., thesecond processor 310-2 and the third processor 310-3), depending on themode of the apparatus 300. Through the individual control of theprocessors, the apparatus 300 according to various embodiments iscapable of reducing power consumption. For example, in the first modefor generating a 2D image, the apparatus 300 according to variousembodiments is capable of reducing power consumed for image acquisitionby interrupting power provided to the second processor 310-2 orproviding power lower than normal power to the second processor 310-2.

FIG. 15 illustrates an example of another example of the functionalconfiguration of an apparatus for controlling power according to variousembodiments of the disclosure. This functional configuration may beincluded in the apparatus 300 illustrated in FIG. 3. FIG. 16 illustratesan example of a plurality of images acquired by an apparatus accordingto various embodiments of the disclosure.

Referring to FIG. 15, the apparatus 300 may include a plurality ofprocessors (first to fifth processors 310-1 to 310-5), a plurality ofcameras (first to seventeenth cameras 330-1 to 330-17), a plurality ofPMICs (first to fifth PMICs 350-1 to 350-5), and a battery 1500.

The first processor 310-1 may control the overall operation of theapparatus 300. In various embodiments, the first processor 310-1 may beinterlocked with other processors (e.g., the second processor 310-2, thethird processor 310-3, the fourth processor 310-4, and the fifthprocessor 310-5) by being operatively connected to the other processors.For example, the first processor 310-1 may receive encoded data for animage acquired through at least one camera connected to the otherprocessors. In various embodiments, the first processor 310-1 may changethe states of the other processors by operatively being connected toPMICs (e.g., the second PMIC 350-2, the third PMIC 350-3, the fourthPMIC 350-4, and the fifth PMIC 350-5) operatively connected to the otherprocessors. As an example, the first processor 310-1 may control a PMICoperatively connected to the other processors so as to interrupt powerprovided to the other processors. As another example, the firstprocessor 310-1 may control the PMIC operatively connected to the otherprocessors so as to resume power supply to the other processors. Invarious embodiments, the first processor 310-1 is capable of acquiringan image through the seventeenth camera 330-17 by being operativelyconnected to the seventeenth camera 330-17. In various embodiments, thefirst processor 310-1 may be supplied with power from the battery 1500through the first PMIC 350-1.

Each of the second to fifth processors 310-2 to 310-5 may acquire animage through a plurality of cameras connected to each of the second tofifth processors 310-2 to 310-5. Each of the second to fifth processors310-2 to 310-5 may generate encoded data for the acquired image. Each ofthe second to fifth processors 310-2 to 310-5 may be supplied with powerfrom the battery 1500 through each of the second to fifth PMICs 350-2 to350-5.

The first to fifth processors 310-1 to 310-5 may correspond to theprocessor 310 illustrated in FIG. 2.

Each of the first camera 330-1, the third camera 330-3, the fifth camera330-5 and the seventh camera 330-7 may be operatively connected to thesecond processor 310-2.

The first camera 330-1 may be configured to be oriented in a firstdirection and may have a first FOV. The first camera 330-1 may perform afunction corresponding to the right eye of a person. The first camera330-1 may be configured to be oriented in a second directioncorresponding to the first direction, and may form a first camera pairwith the second camera 330-2 having a second FOV, which partiallyoverlaps the first FOV. The second camera 330-2 may perform a functioncorresponding to the left eye of a person. The second camera 330-2 maybe operatively connected to the third processor 310-3 that is distinctfrom the second processor 310-2.

The third camera 330-3 may be configured to be oriented in a thirddirection and may have a third FOV. The third camera 330-3 may perform afunction corresponding to the right eye of a person. The third camera330-3 may be configured to be oriented in a fourth directioncorresponding to the third direction, and may form a second camera pairwith the fourth camera 330-4 having a fourth FOV, which partiallyoverlaps the third FOV. The fourth camera 330-4 may perform a functioncorresponding to the left eye of a person. The fourth camera 330-4 maybe operatively connected to the third processor 310-3 that is distinctfrom the second processor 310-2.

The fifth camera 330-5 may be configured to be oriented in a fifthdirection and may have a fifth FOV. The fifth camera 330-5 may perform afunction corresponding to the right eye of a person. The fifth camera330-5 may be configured to be oriented in a sixth directioncorresponding to the fifth direction, and may form a third camera pairwith the sixth camera 330-6 having a sixth FOV, which partially overlapsthe fifth FOV. The sixth camera 330-6 may perform a functioncorresponding to the left eye of a person. The sixth camera 330-6 may beoperatively connected to the third processor 310-3 that is distinct fromthe second processor 310-2.

The seventh camera 330-7 may be configured to be oriented in a seventhdirection and may have a seventh FOV. The seventh camera 330-7 mayperform a function corresponding to the right eye of a person. Theseventh camera 330-7 may be configured to be oriented in an eighthdirection corresponding to the seventh direction, and may form a fourthcamera pair with the eighth camera 330-8 having an eighth FOV, whichpartially overlaps the seventh FOV. The eighth camera 330-8 may performa function corresponding to the left eye of a person. The eighth camera330-8 may be operatively connected to the third processor 310-3 that isdistinct from the second processor 310-2.

Each of the ninth camera 330-9, the eleventh camera 330-11, thethirteenth camera 330-13, and the fifteenth camera 330-15 may beoperatively connected to the fourth processor 310-4.

The ninth camera 330-9 may be configured to be oriented in a ninthdirection and may have a ninth FOV. The ninth camera 330-9 may perform afunction corresponding to the right eye of a person. The ninth camera330-9 may be configured to be oriented in a tenth directioncorresponding to the ninth direction, and may form a fifth camera pairwith the tenth camera 330-10 having a tenth FOV, which partiallyoverlaps the ninth FOV. The tenth camera 330-10 may perform a functioncorresponding to the left eye of a person. The tenth camera 330-10 maybe operatively connected to the fifth processor 310-5 that is distinctfrom the fourth processor 310-4.

The eleventh camera 330-11 may be configured to be oriented in aneleventh direction and may have an eleventh FOV. The eleventh camera330-11 may perform a function corresponding to the right eye of aperson. The eleventh camera 330-11 may be configured to be oriented in atwelfth direction corresponding to the eleventh direction, and may forma sixth camera pair with the twelfth camera 330-12 having a twelfth FOV,which partially overlaps the eleventh FOV. The twelfth camera 330-12 mayperform a function corresponding to the left eye of a person. Thetwelfth camera 330-12 may be operatively connected to the fifthprocessor 310-5 that is distinct from the fourth processor 310-4.

The thirteenth camera 330-13 may be configured to be oriented in athirteenth direction and may have a thirteenth FOV. The thirteenthcamera 330-13 may perform a function corresponding to the right eye of aperson. The thirteenth camera 330-13 may be configured to be oriented ina fourteenth direction corresponding to the thirteenth direction, andmay form a seventh camera pair with the fourteenth camera 330-14 havinga fourteenth FOV, which partially overlaps the thirteenth FOV. Thefourteenth camera 330-14 may perform a function corresponding to theleft eye of a person. The fourteenth camera 330-14 may be operativelyconnected to the fifth processor 310-5 that is distinct from the fourthprocessor 310-4.

The fifteenth camera 330-15 may be configured to be oriented in afifteenth direction and may have a fifteenth FOV. The fifteenth camera330-15 may perform a function corresponding to the right eye of aperson. The fifteenth camera 330-15 may be configured to be oriented ina sixteenth direction corresponding to the fifteenth direction, and mayform an eighteenth camera pair with the sixteenth camera 330-16 having asixteenth FOV, which partially overlaps the fifteenth FOV. The sixteenthcamera 330-16 may perform a function corresponding to the left eye of aperson. The sixteenth camera 330-16 may be operatively connected to thefifth processor 310-5 that is distinct from the fourth processor 310-4.

In order to generate an omnidirectional image, the first FOV maypartially overlap the third FOV and the fifteenth FOV, the second FOVmay partially overlap the fourth FOV and the sixth FOV, the third FOVmay partially overlap the first FOV and the fifth FOV, the fourth FOVmay partially overlap the second FOV and the sixth FOV, the fifth FOVmay partially overlap the third FOV and the seventh FOV, the sixth FOVmay partially overlap the fourth FOV and the eighth FOV, the seventh FOVmay partially overlap the fifth FOV and the ninth FOV, the eighth FOVmay partially overlap the sixth FOV and the tenth FOV, the ninth FOV maypartially overlap the seventh FOV and the eleventh FOV, the tenth FOVmay partially overlap the eighth FOV and the twelfth FOV, the eleventhFOV may partially overlap the ninth FOV and the thirteenth FOV, thetwelfth FOV may partially overlap the tenth FOV and the fourteenth FOV,the thirteenth FOV may partially overlap the eleventh FOV and thefifteenth FOV, the fourteenth FOV may partially overlap the twelfth FOVand the sixteenth FOV, the fifteenth FOV may partially overlap the firstFOV and the thirteenth FOV, and the sixteenth FOV may partially overlapthe second FOV and the fourteenth FOV.

The seventeenth camera 330-17 may be operatively connected to the firstprocessor 310-1. The seventeenth camera 330-17 may be configured to beoriented in a seventeenth direction and may have a seventeenth FOV. Theseventeenth FOV may be substantially perpendicular to the first tosixteenth directions. The seventeenth FOV may partially overlap thefirst FOV, the second FOV, the third FOV, the fourth FOV, the fifth FOV,the sixth FOV, the seventh FOV, the eighth FOV, the ninth FOV, the tenthFOV, the eleventh FOV, the twelfth FOV, the thirteenth FOV, thefourteenth FOV, the fifteenth FOV, and the sixteenth FOV.

The first camera 330-1 may be used to acquire a first image, the secondcamera 330-2 may be used to acquire a second image, the third camera330-3 may be used to acquire a third image, the fourth camera 330-4 maybe used to acquire a fourth image, the fifth camera 330-5 may be used toacquire a fifth image, and the sixth camera 330-6 may be used to acquirethe sixth image, the seventh camera 330-7 may be used to acquire theseventh image, the eighth camera 330-8 may be used to acquire the eighthimage, and the ninth camera 330-9 may be used to acquire the ninthimage. The tenth camera 330-10 may be used to acquire a tenth image, theeleventh camera 330-11 may be used to acquire an eleventh image, thetwelfth camera 330-12 may be used to acquire a twelfth image, thethirteenth camera 330-13 may be used to acquire a thirteen image, thefourteenth camera 330-14 may be used to acquire a fourteenth image, thefifteenth camera 330-15 may be used to acquire a fifteenth image, andthe sixteenth camera 330-16 may be used to acquire a sixteenth image,and the seventeenth camera 330-17 may be used to acquire a seventeenthimage.

For example, referring to FIG. 16, the second image, the fourth image,the sixth image, the eighth image, the tenth image, the twelfth image,the fourteenth image, and the sixteenth image may include a scenecorresponding to the left eye of a person, and the first image, thethird image, the fifth image, the seventh image, the ninth image, theeleventh image, the thirteenth image, and the fifteenth image mayinclude a scene corresponding to the right eye of a person. The secondimage, the fourth image, the sixth image, the eighth image, the tenthimage, the twelfth image, the fourteenth image, and the sixteenth imagemay be combined with the first image, the third image, the fifth image,the seventh image, the ninth image, the eleventh image, the thirteenthimage, and the fifteenth image in order to generate a 3D omnidirectionalimage. Although not illustrated in FIG. 16, the seventeenth image may beused to supplement the first to sixteenth images.

As another example, the second image, the fourth image, the sixth image,the eighth image, the tenth image, the twelfth image, the fourteenthimage, and the sixteenth image may be combined with each other in orderto produce a 2D omnidirectional image. Although not illustrated in FIG.16, the seventeenth image may be combined with the second image, thefourth image, the sixth image, the eighth image, the tenth image, thetwelfth image, the fourteenth image, and the sixteenth image in order togenerate the 2D omnidirectional image.

As another example, the first image, the third image, the fifth image,the seventh image, the ninth image, the eleventh image, the thirteenthimage, and the fifteenth image may be combined with each other in orderto generate another 2D omnidirectional image. Although not illustratedin FIG. 16, the seventeenth image may be combined with the first image,the third image, the fifth image, the seventh image, the ninth image,the eleventh image, the thirteenth image, and the fifteenth image inorder to generate the other 2D omnidirectional image.

As another example, the second image, the fourth image, the sixth image,and the eighth image (or the tenth image, the twelfth image, thefourteenth image, and the sixteenth image) may be combined with eachother in order to generate a 2D panoramic image (i.e., a 180-degreeimage). Although not illustrated in FIG. 16, the seventeenth image maybe combined with the second image, the fourth image, the sixth image,and the eighth image (or the tenth image, the twelfth image, thefourteenth image, and the sixteenth image) in order to generate the 2Dpanoramic image.

As another example, the first image, the third image, the fifth image,and the seventh image (or the ninth image, the eleventh image, thethirteenth image, and the fifteenth image) may be combined with eachother in order to generate another 2D omnidirectional image. Althoughnot illustrated in FIG. 16, the seventeenth image may be combined withthe first image, the third image, the fifth image, and the seventh image(or the ninth image, the eleventh image, the thirteenth image, and thefifteenth image) in order to generate the other 2D panoramic image.

Each of the first to fifth PMICs 350-1 to 350-5 may be used to providepower to each of the first to fifth processors 310-1 to 310-5.

Each of the second to fifth PMICs 350-2 to 350-5 may control powerprovided to each of the second to fifth processors 310-2 to 310-3 basedon a control signal transmitted from the first processor 310-1.

The battery 1500 may be charged through a power supply connected to theapparatus 300. In other words, the battery 1500 may be configured to bechargeable. The battery 1500 may provide power to the first to fifthPMICs 350-1 to 350-5 each operatively connected to the battery 1500. Invarious embodiments, the battery 1500 may be configured to be removablefrom the apparatus 300.

In various embodiments, the first processor 310-1 may identified themode of the apparatus 300. The mode of the apparatus 300 may be changedaccording to the user's input, or may be changed according to the stateof the battery 1500. The first processor 310-1 may change the stateassociated with the power of the first processor 310-1 and at least oneof the other processors based on the identified mode of the apparatus.

As an example, in response to determining that the mode of the apparatus300 is a mode for generating a 2D omnidirectional image, the firstprocessor 310-1 may control the 2PMIC 350-2 and the fourth PMIC 350-4 tointerrupt each of the power supplied to the second processor 310-2 andthe power supplied to the fourth processor 350-4. In response todetermining that the mode of the apparatus 300 is a mode for generatingthe 2D omnidirectional image, the first processor 310-1 may transmit afirst control signal to each of the second PMIC 350-2 and the fourthPMIC 350-4 so as to interrupt each of the power supplied to the secondprocessor 310-2 and the power supplied to the fourth processor 310-4. Asillustrated in FIG. 16, since acquisition of the first image, the thirdimage, the fifth image, the seventh image, the ninth image, the eleventhimage, the thirteenth image, and the fifteenth image may not be requiredin order to generate the 2D omnidirectional image, the first processor310-1 may interrupt the power provided to the second processor 310-2 andthe fourth processor 310-4. Through this interruption, the apparatus 300is capable reducing the power required for the generation of the 2Domnidirectional image.

As another example, in response to determining that the mode of theapparatus 300 is a mode for generating a 2D panoramic image, the firstprocessor 310-1 may control each of the 2PMIC 350-2, the fourth PMIC350-4, the fifth PMIC 350-5 to interrupt each of the power supplied tothe second processor 310-2, the power supplied to the fourth PMIC 350-4,and the power supplied to the fifth PMIC 350-5. In response todetermining that the mode of the apparatus 300 is a mode for generatingthe 2D panoramic image, the first processor 310-1 may transmit the firstcontrol signal to each of the second PMIC 350-2, the fourth PMIC 350-4,and the fifth PMIC 350-5 so as to interrupt each of the power suppliedto the second processor 310-2, the power supplied to the fourthprocessor 310-4, and the power supplied to the fifth processor 310-5. Asillustrated in FIG. 16, since acquisition of the first image, the thirdimage, the fifth image, the seventh image, the ninth image, the tenthimage, the eleventh image, the twelfth image, the thirteenth image, thefourteenth image, the fifteenth image, and the sixteenth image may notbe required in order to generate the 2D panoramic image, the firstprocessor 310-1 may interrupt the power provided to the second processor310-2, the fourth processor 310-4, and the fifth processor 310-5.Through this interruption, the apparatus 300 is capable reducing thepower required for the generation of the 2D panoramic image.

As another example, in response to determining that the mode of theapparatus 300 is a mode for generating a 3D omnidirectional image, thefirst processor 310-1 may control a PMIC connected to other processors(e.g., the second processor 310-2, the fourth processor 310-4, or thefifth processor 310-5) so as to resume power supply to the otherprocessors to which power supply is interrupted (or ceased). In responseto determining that the mode of the apparatus 300 is a mode forgenerating the 3D omnidirectional image, the first processor 310-1 maytransmit a second control signal to the PMIC connected to the otherprocessor where power supply is interrupted so as to resume power supplyto the other processor. Through the resumption of power supply, theapparatus 300 is capable of acquiring a plurality of images forgeneration of a 3D omnidirectional image.

As described above, the apparatus 300 according to various embodimentsis capable of reducing power consumed for acquiring a plurality ofimages by separating a processor coupled to a camera performing afunction corresponding to one eye of a person from a processor coupledto a camera performing a function corresponding to the other eye of theperson.

FIG. 17 illustrates an example of an operation of an apparatus thatcontrols power according to various embodiments of the disclosure. Thisoperation may be performed by any of the apparatus 300 illustrated inFIG. 3, the apparatus 300 illustrated in FIG. 14, the apparatus 300illustrated in FIG. 15, or a component of the apparatus 300 (e.g., theprocessor 310 of FIG. 3), the first processor 310-1 of FIG. 14, or thefirst processor 310-1 of FIG. 15.

Referring to FIG. 17, at operation 1710, the first processor 310-1 maydetermine that the apparatus 300 operates in the first mode among aplurality of modes. The first processor 310-1 may determine that theapparatus 300 operates in the first mode among the plurality of modes inorder to reduce the power consumed for acquiring images. The pluralityof modes may include a mode for acquiring a plurality of images forgenerating a 2D omnidirectional image, a mode for acquiring a pluralityof images for generating a 3D omnidirectional image, a mode foracquiring a plurality of images generating a 2D panoramic image, and/ora mode for acquiring a plurality of images for generating a 3D panoramicimage. The first mode may be a mode in which acquisition of some of theimages that can be acquired by the apparatus 300 is not required. Forexample, the first mode may be a mode for acquiring a plurality ofimages for generating a 2D omnidirectional image, a mode for acquiring aplurality of images for generating a 2D panoramic image, and/or a modefor acquiring a plurality of images for generating a 3D panoramic image.

In various embodiments, the first processor 310-1 may determine that theapparatus 300 operates in the first mode by monitoring whether a userinput is detected through an input device 370 of the apparatus 300, ormonitoring whether the state of the battery of the apparatus 300 is thedesignated state.

In operation 1720, the first processor 310-1 may control theinterruption of power supply to the second processor 310-2. The secondprocessor 310-2 may be a processor operatively connected to at least onecamera, which is not used in the first mode (i.e., at least one camerafor which acquisition of an image is not required). In the first mode,since the second processor 310-2 is not required to control at least onecamera connected to the second processor 310-2 in order to acquire animage, the second processor 310-2 may be a processor that does notrequire power supply. The second processor 310-2 where power supply isinterrupted may be booted for reactivation. Alternatively, the firstprocessor 310-1 may reduce power supplied to the second processor 310-2in response to determining that the apparatus 300 operates in the firstmode. For example, in response to determining that the apparatus 300operates in the first mode, the first processor 310-1 may supply powerlower than normal power to the second processor 310-2. The firstprocessor 310-1 may supply the second processor 310-2 with power lowerthan the normal power such that the second processor 310-2 does notperform booting again even if the second processor 310-2 is reactivated.In the apparatus 300 according to various embodiments, when a fastresponse rate (i.e., fast state transition) of the second processor310-2 is required, the first processor 310-1 may supply the secondprocessor 310-2 with power lower than the normal power withoutinterrupting power supply to the second processor 310-2.

FIG. 18 illustrates an example of signal flow in an apparatus thatcontrols power according to various embodiments of the disclosure. Thissignal flow may be caused in the apparatus 300 illustrated in FIG. 3,the apparatus 300 illustrated in FIG. 14, and the apparatus 300illustrated in FIG. 15.

Referring to FIG. 18, in operation 1810, the first processor 310-1 maydetermine that the apparatus 300 operates in the first mode among aplurality of modes. The first processor 310-1 may determine that theapparatus 300 operates in a first image-capturing mode in which use ofat least one processor or camera is not required, among a plurality ofimage-capturing modes that can be provided by the apparatus 300. The atleast one processor may include a second processor 310-2.

In operation 1820, the first processor 310-1 may receive a signalindicating the state of the second processor 310-2 from the secondprocessor 310-2. The first processor 310-1 may receive a signalindicating the state of the second processor 310-2 from the secondprocessor 310-2 based on a first communication method. In variousembodiments, a signal indicating the state of the second processor 310-2may be transmitted from the second processor 310-2 in response to arequest from the first processor 310-1. In various embodiments, a signalindicating the state of the second processor 310-2 may be transmittedfrom the second processor 310-2 based on a designated period. Forexample, a signal indicating the state of the second processor 310-2 maybe transmitted from the second processor 310-2 every designated periodwhen normal power is supplied to the second processor 310-2 or powerlower than the normal power is supplied to the second processor 310-2.The signal indicating the state of the second processor 310-2 may beused to indicate whether or not power is being supplied to the secondprocessor 310-2. The first communication method may be associated withGPIO. Unlike the illustration of FIG. 18, when the second processor310-2 is in the state in which no power is supplied thereto, the firstprocessor 310-1 may determine that no power is supplied to the secondprocessor 310-2 by not receiving the signal indicating the state of thesecond processor 310-2.

In operation 1830, the first processor 310-1 may determine whether thesecond processor 310-2 is in the active state. The first processor 310-1may determine whether the second processor 310-2 is in the active statebased on the signal indicating the state of the second processor 310-2,which is received from the second processor 310-2. When it is determinedthat the second processor 310-2 is not in the active state (e.g., whenthe second processor 310-2 is in the state in which power lower than thenormal power is supplied thereto, or in the state in which power supplyto the second processor 310-2 is interrupted), the first processor 310-1may maintain the state of the second processor 310-2. Unlike this, whenit is determined that the second processor 310-2 is in the active state,the first processor 310-1 may perform operation 1840.

In operation 1840, when it is determined that the second processor 310-2is in the active state, the first processor 310-1 may transmit a controlsignal for interrupting the power supplied to the second processor 310-2to the second PMIC 350-2 operatively coupled to the second processor310-2. In response to determining that the second processor 310-2 is inthe active state, the first processor 310-1 may transmit the controlsignal for interrupting the power supplied to the second processor 310-2using a second communication method. The second communication method maybe associated with a SPI. The second PMIC 350-2 may receive the controlsignal for interrupting power supplied to the second processor 310-2from the first processor 310-1 through the second communication method.

In operation 1850, the second PMIC 350-2 may interrupt the powersupplied to the second processor 310-2 in response to receiving thecontrol signal. The second PMIC 350-2 may interrupt the power suppliedto the second processor 310-2 in order to reduce the power unnecessarilyconsumed due to the operation of the second processor 310-2.

FIG. 18 illustrates the case in which the power supply to the secondprocessor 310-2 is interrupted (or ceased) in response to determiningthat the apparatus 300 is operating in the first mode, but this ismerely an example for illustration. In various embodiments, in responseto determining that the apparatus 300 operates in the first mode, thefirst processor 310-1 may transmit, to the second PMIC 350-2, thecontrol signal for reducing power supplied to the second processor310-2. The second PMIC 350-2, which receives the control signal forreducing the power supplied to the second processor 310-2, may supplythe second processor 310-2 with power lower than the normal power.

As described above, in the apparatus 300 according to variousembodiments, the first processor 310-1 is capable of reducing theconsumption of power consumed for image acquisition through signalingwith another processor (e.g., the second processor 310-2) or a PMIC(e.g., the second PMIC 350-2) connected to the other processor.

FIG. 19 illustrates an example of a mode control operation of anapparatus that controls power according to various embodiments of thedisclosure. This operation may be performed by any of the apparatus 300illustrated in FIG. 3, the apparatus 300 illustrated in FIG. 14, theapparatus 300 illustrated in FIG. 15, or a component of the apparatus300 (e.g., the processor 310 of FIG. 3), the first processor 310-1 ofFIG. 14, or the first processor 310-1 of FIG. 15).

FIG. 20 illustrates an example of a user interface (UI) displayed in anapparatus according to various embodiments of the disclosure.

Operations 1910 to 1940 of FIG. 19 may be associated with operation 1710of FIG. 17.

Referring to FIG. 19, in operation 1910, the first processor 310-1 maydisplay a menu for determining the mode of the apparatus 300. Forexample, referring to FIG. 20, the first processor 310-1 may display aUI 2000 including the menu through the display 390 illustrated in FIG.3. The menu may include a plurality of modes available in the apparatus300. For example, the menu may include a panoramic mode for acquiring apanoramic image, a 2D mode for acquiring a 2D image, and a 3D mode foracquiring a 3D image.

The menu may be displayed based on various conditions. For example, thefirst processor 310-1 may display the menu based on a user's operationfor displaying the menu. As another example, the first processor 310-1may display the menu based on booting of the apparatus 300.

In various embodiments, unlike the illustration of FIG. 19, theprocessor 310-1 may display the menu through a display (e.g., thedisplay device 160) of an electronic device connected to apparatus 300.To this end, the first processor 310-1 may transmit information fordisplaying the menu to the electronic device 101 through thecommunication interface 340 illustrated in FIG. 3. The electronic device101 may display the menu via an application for the apparatus (e.g., anapplication for remotely controlling the apparatus 300), based on theinformation received from the apparatus 300.

In operation 1920, the first processor 310-1 may determine whether aninput for the displayed menu is detected. When detecting the input forthe displayed menu, the first processor 310-1 may perform operation1930. Unlike this, when the input for the displayed menu is notdetected, the first processor 310-1 may monitor whether the input isdetected while continuously displaying the menu.

In various embodiments, the first processor 310-1 may drive a timer inresponse to the displaying of the menu. The timer can be used to limitthe time for which the menu is displayed. For example, when an input forthe displayed menu is not detected until the timer expires, the firstprocessor 310-1 may control the apparatus 300 to operate in a defaultmode. The length of the timer may have a fixed value or a variablevalue. For example, the length of the timer may be changed depending onthe remaining amount of the battery of the apparatus 300. As anotherexample, the length of the timer may be changed depending on the settingof the user.

Unlike the illustration of FIG. 19, when the menu is displayed on theelectronic device 101, the first processor 310-1 may receive informationon the input for the menu from the electronic device 101.

In operation 1930, in response to detecting the input for the menu, thefirst processor 310-1 may determine whether the detected input is aninput for a first object representing the first mode among the pluralityof modes. The first mode may be a mode in which driving of at least oneof the plurality of processors included in the apparatus 300 is notrequired. The first mode may be a mode requiring a lower powerconsumption than at least one other mode in the plurality of modes. Thefirst mode may be the second mode or the panoramic mode. For example,referring to FIG. 20, the processor 310-1 may determine whether thedetected input is an input for an object representing the panoramic modeor an object representing a 2D mode. When it is determined that thedetected input is an input for the first object that represents thefirst mode among the plurality of modes, the first processor 310-1 mayperform operation 1940. Unlike this, when it is determined that thedetected input is not an input for the object representing the firstmode among the plurality of modes, the first processor 310-1 mayterminate the algorithm.

In operation 1940, the first processor 310-1 may determine that theapparatus 300 operates in the first mode. The first processor 310-1 mayperform an operation for changing the power state of the processorconnected to at least one camera that does not acquire an image in thefirst mode, based on determining that the apparatus 300 operates in thefirst mode.

As described above, in the apparatus 300 according to variousembodiments, the first processor 310-1 may determine the mode of theapparatus 300 according to the user's input, and may reduce the powerconsumed for acquisition of an image in the apparatus 300, based on thedetermined mode.

FIG. 21 illustrates another example of the mode control operation of anapparatus that controls power according to various embodiments of thedisclosure. This operation may be performed by any of the apparatus 300illustrated in FIG. 3, the apparatus 300 illustrated in FIG. 14, theapparatus 300 illustrated in FIG. 15, or a component of the apparatus300 (e.g., the processor 310 of FIG. 3, the first processor 310-1 ofFIG. 14, or the first processor 310-1 of FIG. 15).

FIG. 22 illustrates another example of a UI displayed in an apparatusaccording to various embodiments of the disclosure.

Operations 2110 to 2160 of FIG. 21 may be associated with operation 1710of FIG. 17.

Referring to FIG. 21, in operation 2110, the first processor 310-1 maydetermine that the apparatus 300 operates in the second mode among aplurality of modes. The second mode may be a mode in which all of theplurality of cameras included in the apparatus 300 are used. Forexample, the second mode may be a mode for generating a 3Domnidirectional image. The second mode may be a mode consuming morepower than at least one mode other than the second mode in the pluralityof modes.

In operation 2120, the first processor 310-1 may monitor the state ofthe battery 1500. For example, the first processor 310-1 may monitor thestate of the battery 1500 in order to determine power consumptionaccording to the second mode.

In operation 2130, the first processor 310-1 may determine whether thestate of the monitored battery 1500 is a designated state. Thedesignated state may be associated with the power state of the battery1500. For example, the designated state may include a state where theremaining amount of the battery 1500 is less than the reference value.When the remaining amount of the battery 1500 is less than the referencevalue, the first processor 310-1 may determine the remaining usage timeof the apparatus 300, which is determined based on the remaining amountof the battery 1500, and a time for which the apparatus 300 is to beused to acquire a plurality of images (i.e., a predicted use time). Thefirst processor 310-1 may determine whether to switch to the first modebased on the determined relationship. As another example, the designatedstate may include a state where the decrease rate of the power of thebattery 1500 is equal to or higher than a designated rate. When thestate of the battery 1500 is not the designated state, the firstprocessor 310-1 may continuously monitor the state of the battery 1500.Unlike this, when the state of the battery 1500 is the designated state,the first processor 310-1 may perform operation 2140.

In operation 2140, in response to determining that the state of thebattery 1500 is the designated state, the first processor 310-1 maydisplay a message indicating that the mode of the apparatus 300 isswitched to the first mode. The first mode is a mode in which powerlower than that of the second mode is consumed, and cameras, the numberof which is smaller than the number of cameras (or processors) used inthe second mode (or smaller than the number of processors used in thesecond mode), are used. For example, referring to FIG. 22, the firstprocessor 310-1 may display a UI 2200 including a message indicatingthat the mode of the apparatus 300 is switched to the first mode inorder to reduce power consumption. The UI 2200 may include a text 2205indicating that the mode is switched to the first mode. The UI 2200 mayinclude a timer 2210 indicating a time remaining until being switched tothe first mode. The timer 2210 may be driven on the condition that it isdetermined that the state of the battery 1500 is the designated state.The length of the timer 2210 may be configured with a fixed value. Thelength of the timer 2210 may be changed depending on the user's settingor the state of the battery.

In operation 2150, the first processor 310-1 may switch the mode of theapparatus 300 to the first mode. The first processor 310-1 may switchthe mode of the apparatus 300 to the first mode based on determiningthat the state of the battery 1500 is the designated state. In variousembodiments, the first processor 310-1 may switch the mode of theapparatus 300 to the first mode in response to determining that thestate of the battery 1500 is the designated state. The UI 2200 may notinclude the timer 2210. Operation 2140 and operation 2150 may beperformed simultaneously or in reverse order.

In operation 2160, the first processor 310-1 may determine that theapparatus 300 operates in the first mode by switching the mode of theapparatus 300 to the first mode.

As described above, in the apparatus 300 according to variousembodiments, the first processor 310-1 is capable of reducing powerconsumed in the apparatus by switching the mode of the apparatus to amode in which power consumption can be adaptively reduced according tothe state of the battery.

FIG. 23 illustrates an example of the functional configuration of anapparatus that controls image processing according to variousembodiments of the disclosure. This functional configuration may beincluded in the apparatus 300 illustrated in FIG. 3.

Referring to FIG. 23, the apparatus 300 may include a first processor310-1, a second processor 310-2, a third processor 310-3, a memory 320,a first camera 330-1, a second camera 330-2, a first PMIC 350-1, asecond PMIC 350-2, and a third PMIC 350-3.

The first processor 310-1 may request other processors (e.g., the secondprocessor 310-2 and the third processor 310-3) of the apparatus 300,which are operatively connected to cameras, to capture (or acquire) animage or may request encoded data of a captured image from the otherprocessors. The first processor 310-1 may request first encoded data foran image acquired through the first camera 330-1 from the secondprocessor 310-2 operatively connected to the first camera 330-1. Thefirst processor 310-1 may request second encoded data for an imageacquired through the second camera 330-2 from the third processor 310-3operatively connected to the second camera 330-2. The first encoded dataand the second encoded data are usable to generate a final image. Eachof the first encoded data and the second encoded data may beindependently decodable.

The first processor 310-1 may determine the mode of the apparatus 300.The mode of the apparatus 300 may include at least one of a mode forgenerating a 2D omnidirectional image, a mode for generating a 2Dpanoramic image, a mode for generating a 3D panoramic image, or a modefor generating an 3D omnidirectional image. The mode of the apparatus300 may include a mode using all the cameras of the apparatus 300 and amode using some of the cameras of the apparatus 300. The first processor310-1 may determine the mode of the apparatus 300 in order to determinethe processor from which encoded data will be requested. For example,when the apparatus 300 operates in a mode using the second camera 330-2without using the first camera 330-1 in order to acquire an image, thefirst processor 310-1 may request encoded data only from the thirdprocessor 310-3. The first processor 310-1 is capable of reducing thecalculation amount of the second processor 310-2 by not requesting theencoded data from the second processor 310-2. In addition, in order toreduce the power consumed by the second processor 310-2, the firstprocessor 310-1 may transmit a signal for interrupting the powersupplied to the second processor 310-2 (or a signal for reducing thepower supplied to the second processor 310-2) to the second PMIC 350-2.As another example, when the apparatus 300 operates in a mode using thefirst camera 330-1 and the second camera 330-2 in order to acquire animage, the first processor 310-1 may request encoded data from each ofthe second processor 310-2 and the third processor 310-3.

The first processor 310-1 may correspond to the processor 310 of theapparatus 300 illustrated in FIG. 3.

The second processor 310-2 may receive a request for encoded data fromthe first processor 310-1. The request for the encoded data may bereceived from the first processor 310-1 in response to determining thatthe mode of the apparatus 300 is a mode in which it is required that animage is acquired through the first camera 330-1.

In response to the request, the second processor 310-2 may acquire theimage through the first camera 330-1 operatively connected to the secondprocessor 310-2. The second processor 310-2 may encode the acquiredimage. The second processor 310-2 may generate first encoded data byencoding the acquired image. The first encoded data may be independentlydecodable. The first encoded data may be configured to be decodableindependently without a combination with other encoded data (e.g., acombination with second encoded data generated by the third processor310-3).

The second processor 310-2 may provide the first encoded data to thethird processor 310-3.

The second processor 310-2 may correspond to the processor 310 of theapparatus 300 illustrated in FIG. 3.

The third processor 310-3 may receive a request for encoded data fromthe first processor 310-1. In various embodiments, the request for theencoded data may be received from the first processor 310-1, regardlessof the mode of the apparatus 300 when image acquisition is desired. Inother words, since the second camera 330-2 operatively connected to thethird processor 310-3 is a camera that is always used regardless of themode of the apparatus 300, the request for the encoded data may bereceived from the first processor 310-1 regardless of the mode of theapparatus 300 when an event for acquiring an image occurs in theapparatus 300.

In response to the request, the third processor 310-3 may acquire theimage through the second camera 330-2 operatively connected to the thirdprocessor 310-3. The third processor 310-3 may encode the acquiredimage. The third processor 310-3 may generate second encoded data byencoding the acquired image. The second encoded data may beindependently decodable. The second encoded data may be configured to bedecodable independently without a combination with other encoded data(e.g., a combination with the first encoded data generated by the secondprocessor 310-2).

The third processor 310-3 may provide the second encoded data to thefirst processor 310-1. In various embodiments, when receiving the firstencoded data from the second processor 310-2, the third processor 310-3may transmit the second encoded data, together with the first encodeddata, to the first processor 310-1. The first encoded data and thesecond encoded data provided to the first processor 310-1 may beindependent from each other. In other words, the third processor 310-3may provide the first encoded data and the second encoded data to thefirst processor 310-1 as separate data.

The third processor 310-3 may correspond to the processor 310 of theapparatus 300 illustrated in FIG. 2.

The first processor 310-1 may receive only the second encoded data fromthe third processor 310-3 when the apparatus 300 operates in a mode inwhich it is not required that an image is acquired through the firstcamera. Unlike this, when the apparatus 300 is operating in a mode inwhich it is required that an image is acquired through the first camera,it is possible to receive the first encoded data and the second encodeddata from the third processor 310-3.

The first processor 310-1 may process the received encoded data.

In various embodiments, the first processor 310-1 may store the receivedencoded data (e.g., the first encoded data and/or the second encodeddata) as one data set. For example, when the apparatus 300 operates in amode in which it is not required that an image is acquired through thefirst camera, the first processor 310-1 may store only the receivedsecond encoded data as one data set. In another example, when theapparatus 300 operates in a mode in which it is required that an imageis acquired through the first camera, the first processor 310-1 maystore both of the received first encoded data and the received secondencoded data as one data set. The one data set may be a data processingunit for generating a final image (e.g., a 2D omnidirectional image, a3D omnidirectional image, a 2D panoramic image, or a 3D panoramic 3Dimage). The encoded data contained in the one data set may beindependently decodable, regardless of other encoded data contained inthe one data set. The first processor 310-1 may store the one data setin the memory 320. For example, the first processor 310-1 may store theone data set in the memory 320 in order to generate a final image basedon the one data set in another apparatus (e.g., the electronic device101 illustrated in FIG. 1). For example, the first processor 310-1 maystore the one data set in the memory 320 in order to generate a finalimage based on the one data set in the apparatus 300.

In various embodiments, the first processor 310-1 may transmit thereceived encoded data to another apparatus (e.g., the electronic device101) as one data set. The first processor 310-1 may transmit the onedata set to the other apparatus in order to generate the final imagebased on the one data set in the other apparatus. The encoded data inthe one data set transmitted to the other apparatus may be independentlydecodable in the other apparatus. For example, when the first encodeddata and the second encoded data are included in the one data set, theother apparatus, which has received the one data set, may determine thefirst encoded data from the one data set, and may decode the firstencoded data regardless of whether the second encoded data is decoded ornot, thereby generating at least one image. The other apparatus, whichhas received the one data set, may determine the second encoded datafrom the one data set, and may decode the second encoded data regardlessof whether the first encoded data is decoded or not, thereby generatingone image.

According to various embodiments, the apparatus 300 may transmit the onedata set to another apparatus. The other apparatus may receive the onedata set. The other apparatus may decode at least a part of dataincluded in the one data set. For example, in order to generate a 2Domnidirectional image, the other apparatus may decode the first encodeddata to generate the 2D omnidirectional image. In order to generate the2D omnidirectional image, the other apparatus may acquire imagesincluded in the first encoded data and captured from a plurality ofcameras by decoding the first encoded data, and may generate the 2Domnidirectional image by stitching the acquired images.

The apparatus 300 according to various embodiments may generate thefinal image regardless of the mode of the apparatus 300 in an imageacquisition procedure by configuring the encoded data to beindependently decodable. For example, even though the apparatus 300 hasacquired a plurality of images based on a mode in which both of thefirst camera 330-1 and second camera 330-2 are used, the apparatus 300or the electronic device 101 connected to the apparatus 300 maygenerate, in a stitching procedure, the final image based on the firstencoded data (or the second encoded data) among the first encoded datafor the image acquired from the first camera 330-1 and the secondencoded data for the image acquired from the second camera 330-2.

The first camera 330-1 may be operatively connected to the secondprocessor 310-2. The first camera 330-1 may be configured to be orientedin a first direction. The first camera 330-1 may have a first FOV.Optical data associated with the image acquired through the first camera330-1 may be provided to the second processor 310-2.

The first camera 330-1 may correspond to the camera 330 of the apparatus300 illustrated in FIG. 3.

The second camera 330-2 may be operatively connected to the thirdprocessor 310-3. The second camera 330-2 may be configured to beoriented in a second direction corresponding to the first direction. Thesecond camera 330-2 may have a second FOV, which partially overlaps thefirst FOV. Since the second camera 330-2 is configured to be oriented inthe second direction corresponding to the first direction and has thesecond FOV partially overlapping the first FOV, the second camera 330-2may perform the same function as the left eye of a person relative tothe first camera 330-1. In other words, the first camera 330-1 mayperform a function, which is the same as the right eye of a personrelative to the second camera 330-2. In other words, when only theimages acquired through the second camera 330-2 are used, the finalimage may be a 2D image, and when both the images acquired through thefirst camera 330-1 and the images acquired through the second camera330-2 are used, the final image may be a 3D image. Optical dataassociated with the image acquired through the second camera 330-2 maybe provided to the third processor 310-3. According to one embodiment,the second camera 330-2 may be a camera used, regardless of the mode ofthe apparatus 300, when the apparatus 300 acquires an image. Forexample, the second camera 330-2 may be a camera used, regardless of themode, when the second camera 330-2 is set to operate in both of the 2Dmode operation and the 3D mode operation.

The second camera 330-2 may correspond to the camera 330 of theapparatus 300 illustrated in FIG. 3.

The first PMIC 350-1 may be used to provide power to the first processor310-1.

The second PMIC 350-2 may be used to provide power to the secondprocessor 310-2. When the second PMIC 350-2 receives, from the firstprocessor 310-1, a signal for stopping supplying power to the secondprocessor 310-2 from the first processor 310-1 or for reducing the powersupplied to the second processor 310-2, the second PMIC 350-2 may stopsupplying power to the second processor 310-2 or may reduce the powersupplied to the second processor 310-2.

The third PMIC 350-3 may be used to provide power to the third processor310-3. Each of the first PMIC 350-1, the second PMIC 350-2, and thethird PMIC 350-3 may correspond to the PMIC 350 of the apparatus 300illustrated in FIG. 3.

The memory 320 may store or temporarily store provided encoded data. Thememory 320 may store the provided encoded data as the one data set. Forexample, when only the second encoded data is provided, the memory 320may store only the second encoded data as one data set. In anotherexample, when the second encoded data and the third encoded data areprovided, the memory 320 may store both the first encoded data and thesecond encoded data as one data set. In various embodiments, the onedata set stored in the memory 320 may be transmitted to anotherapparatus (e.g., the electronic device 101) for performing decoding andstitching in order to generate a final image. In various embodiments,the one data set stored in the memory 320 may be decoded and stitched inthe apparatus 300 in order to generate a final image.

As described above, in various embodiments, the apparatus 300 mayseparate a processor connected to a camera that is used regardless ofthe mode of the apparatus 300 (e.g., the third processor 310-3) and aprocess connected to a camera that is not used depending on the mode ofthe apparatus 300 (e.g., the second processor 310-2). Through thisdistinction, the apparatus 300 is capable of reducing a calculationamount required to execute a particular mode. As an example, the secondcamera 330-2 may be a camera used, regardless of the mode of theapparatus 300, when the apparatus 300 acquires an image. For example,the second camera 330-2 may be a camera used, regardless of the mode,when the second camera 330-2 is set to operate in both of the 2D modeoperation and the 3D mode operation.

In various embodiments, the encoded data generated in the apparatus 300may be independently decodable. Through encoded data configured to beindependently decodable, the apparatus 300 is capable of independentlyoperating the attribute of the target final image in the imageacquisition operation and the attribute of the final image in the imagestitching operation. Through the encoded data configured to beindependently decodable, the apparatus, which performs the operation ofgenerating the final image, may inquire encoded data more quickly.

FIG. 24 illustrates another example of the functional configuration ofan apparatus that controls image processing according to variousembodiments of the disclosure. This functional configuration may beincluded in the apparatus 300 illustrated in FIG. 3.

First to sixteenth cameras 330-1 to 330-16 in FIG. 24 may respectivelycorrespond to the first to sixteenth cameras 330-1 to 330-16 illustratedin FIG. 15.

Referring to FIG. 24, the apparatus 300 may include first to fifthprocessors 310-1 to 310-5, a memory 320, first to sixteenth cameras330-1 to 330-16, a communication interface 340, a microphone 360-1, anda microphone 360-2.

In response to the operation of the apparatus 300 in a mode forgenerating a 3D omnidirectional image, the first processor 310-1 mayrequest encoded data from the second processor 310-2, the thirdprocessor 310-3, the fourth processor 310-4, and the fifth processor310-5. Referring to FIG. 16, in order to generate a 3D omnidirectionalimage, it may be required to acquire the first to sixteenth images. Thefirst processor 310-1 may request encoded data, which is generated byencoding the first image, the third image, the fifth image, and theseventh image, from the second processor 310-2, which is operativelyconnected to the first camera 330-1 configured to acquire the firstimage, the third camera 330-3 configured to acquire the third image, thefifth camera 330-5 configured to acquire the fifth image, and theseventh camera 310-7 configured to acquire the seventh image. The firstprocessor 310-1 may request encoded data, which is generated by encodingthe ninth image, the eleventh image, the thirteenth image, and thefifteenth image, from the fourth processor 310-4, which is operativelyconnected to the ninth camera 330-9 configured to acquire the ninthimage, the eleventh camera 330-11 configured to acquire the eleventhimage, the thirteenth camera 310-13 configured to acquire the thirteenthimage, and the fifteenth camera 330-15 configured to acquire thefifteenth image.

The first processor 310-1 may transmit a synchronization signal forsynchronization of the first to sixteenth cameras 330-1 to 330-16. Thesynchronization signal may include information associated with anoperating frequency. For example, the first processor 310-1 may transmitthe synchronization signal to each of the first to sixteenth cameras330-1 to 330-16. Some of the transmitted synchronization signals mayhave a phase different from the other ones of the transmittedsynchronization signals in order to reduce noise caused between thecameras. As an example, at least one of the synchronization signals mayhave a first phase, while at least one of the other synchronizationsignals may have a second phase. As an example, there may be a phasedifference of 180 between the phase of a synchronization signal suppliedto a first camera set including the first camera 330-1, the secondcamera 330-2, the third camera 330-3, the fourth camera 330-4, the ninthcamera 330-9, the tenth camera 330-10, the eleventh camera 330-11, andthe twelfth camera 330-12 and the phase of the synchronization signalprovided to a second camera set including the fifth camera 330-5, thesixth camera 330-6, the seventh camera 330-7, the eighth camera 330-8,the thirteenth camera 330-13, the fourteenth camera 330-14, thefifteenth camera 330-15), and the 16th camera 330-16. The firstprocessor 310-1 may cause the acquisition time points of the pluralityof images acquired from the cameras 330-1 to 330-16 to be matchedthrough the transmission of the synchronization signal. As anotherexample, the phase of the synchronization signal provided to each of thefirst camera 330-1, the fifth camera 330-5, the ninth camera 330-9, thethirteenth camera 330-13, the tenth camera 330-10, the fourteenth camera330-14, the second camera 330-2, and the sixth camera 330-6 may bedifferent from the phase of the synchronization signal provided to eachof the third camera 330-3, the seventh camera 330-7, the eleventh camera330-11, the fifteenth camera 330-15, the twelfth camera 330-12, thesixteenth camera 330-16, the fourth camera 330-4, and the eighth camera330-8, which are disposed adjacent to the first camera 330-1, the fifthcamera 330-5, the ninth camera 330-9, the thirteenth camera 330-13, thetenth camera 330-10, the fourteenth camera 330-14, the second camera330-2, and the sixth camera 330-6, respectively. The phase difference ofthe synchronization signals may be 180 degrees.

In another example, the first processor 310-1 may transmit thesynchronization signals to each of the second processor 310-2, the thirdprocessor 310-3, the fourth processor 310-4, and the fifth processor310-5. Each of the transmitted synchronization signals may be receivedby the first to sixteenth cameras 330-1 to 330-16 through each of thesecond to fifth processors 310-2 to 310-5. At least some of the first tosixteenth cameras 330-1 to 330-16 may receive a synchronization signalon which phase conversion has been performed at least some of the secondprocessor 310-2, the third processor 310-3, the fourth processor 310-4,and the fifth processor 310-5 in order to reduce noise.

The second processor 310-2 may be operatively connected to the firstcamera 330-1, the third camera 330-3, the fifth camera 330-5, and theseventh camera 330-7. For example, the second processor 310-2 may beoperatively connected to the first camera 330-1, the third camera 330-3,the fifth camera 330-5, and the seventh camera 330-7 through an FPGA(not illustrated). The second processor 310-2 may acquire the firstimage through the first camera 330-1, may acquire the third imagethrough the third camera 330-3, may acquire the fifth image through thefifth camera 330-5, and may acquire the seventh image through theseventh camera 330-7. The second processor 310-2 may receive the firstimage, the third image, the fifth image, and the seventh image throughthe FPGA. The second processor 310-2 may generate first encoded databased on the first image, the third image, the fifth image, and theseventh image. The second processor 310-2 may generate the first encodeddata by encoding the first image, the third image, the fifth image, andthe seventh image. The first encoded data may be independently decodableregardless of the other encoded data. The second processor 310-2 mayprovide the first encoded data to the fourth processor 310-4.

The fourth processor 310-4 may be operatively connected to the ninthcamera 330-9, the eleventh camera 330-11, the thirteenth camera 330-13,and the fifteenth camera 330-15. For example, the fourth processor 310-4may be operatively connected to the ninth camera 330-9, the eleventhcamera 330-11, the thirteenth camera 330-13, and the fifteenth camera330-15 through the FPGA. The fourth processor 310-4 may acquire theninth image through the ninth camera 330-9, may acquire the eleventhimage through the eleventh camera 330-11, may acquire the thirteenthimage through the thirteenth camera 330-13, and may acquire thefifteenth image through the fifteenth camera 330-15. The fourthprocessor 310-4 may receive the ninth image, the eleventh image, thethirteenth image, and the fifteenth image through the FPGA. The fourthprocessor 310-4 may generate third encoded data based on the ninthimage, the eleventh image, the thirteenth image, and the fifteenthimage. The fourth processor 310-4 may generate the third encoded data byencoding the ninth image, the eleventh image, the thirteenth image, andthe fifteenth image. The third encoded data may be independentlydecodable regardless of the other encoded data. The fourth processor310-4 may provide the first encoded data and the third encoded data tothe fifth processor 310-5. Each of the first encoded data and the thirdencoded data provided to the fifth processor 310-5 may be configured tobe independently decodable.

The fifth processor 310-5 may be operatively connected to the tenthcamera 330-10, the twelfth camera 330-12, the fourteenth camera 330-14,and the sixteenth camera 330-16. For example, the fifth processor 310-5may be operatively connected to the tenth camera 330-10, the twelfthcamera 330-12, the fourteenth camera 330-14, and the sixteenth camera330-16 through the FPGA. The fifth processor 310-5 may acquire the tenthimage through the tenth camera 330-10, may acquire the twelfth imagethrough the twelfth camera 330-12, may acquire the fourteenth imagethrough the fourteenth camera 330-14, and may acquire the sixteenthimage through the sixteenth camera 330-16. The fifth processor 310-5 mayreceive the tenth image, the twelfth image, the fourteenth image, andthe sixteenth image through the FPGA. The fifth processor 310-5 maygenerate fourth encoded data based on the tenth image, the twelfthimage, the fourteenth image, and the sixteenth image. The fifthprocessor 310-5 may generate the fourth encoded data by encoding thetenth image, the twelfth image, the fourteenth image, and the sixteenthimage. The fourth encoded data may be independently decodable regardlessof the other encoded data. The fifth processor 310-5 may provide thefirst encoded data, the third encoded data, and the fourth encoded datato the third processor 310-3. Each of the first encoded data, the thirdencoded data, and the fourth encoded data provided to the thirdprocessor 310-3 may be configured to be independently decodable.

The third processor 310-3 may be operatively connected to the secondcamera 330-2, the fourth camera 330-4, the sixth camera 330-6, and theeighth camera 330-8. For example, the third processor 310-3 may beoperatively connected to the second camera 330-2, the fourth camera330-4, the sixth camera 330-6, and the eighth camera 330-8 through theFPGA. The third processor 310-3 may acquire the second image through thesecond camera 330-2, may acquire the fourth image through the fourthcamera 330-4, may acquire the sixth image through the sixth camera330-6, and may acquire the eighth image through the eighth camera 330-8.The third processor 310-3 may receive the second image, the fourthimage, the sixth image, and the eighth image through the FPGA. The thirdprocessor 310-3 may generate second encoded data based on the secondimage, the fourth image, the sixth image, and the eighth image. Thethird processor 310-3 may generate the second encoded data by encodingthe second image, the fourth image, the sixth image, and the eighthimage. The second encoded data may be independently decodable regardlessof the other encoded data.

The third processor 310-3 receives audio associated with at least one ofthe first to sixteenth images through the microphone 360-2 operativelyconnected to the third processor 310-3. The microphone 360-2 may not beincluded in the apparatus 300 according to embodiments. The microphone360-2 may be constituted with a plurality of sets or groups ofmicrophones according to embodiments. The third processor 310-3 maygenerate second audio encoded data based on the received audio. Thesecond audio encoded data may be independently decodable regardless ofother encoded data.

The third processor 310-3 may provide the first encoded data, the secondencoded data, the third encoded data, the fourth encoded data, and thesecond audio encoded data to the first processor 310-1. Each of thefirst encoded data, the second encoded data, the third encoded data, thefourth encoded data, and the second audio encoded data provided to thefirst processor 310-1 may be configured to be independently decodable.

Although not illustrated in FIG. 24, in response to the operation of theapparatus 300 in a mode for generating a 3D omnidirectional image, thefirst processor 310-1 may acquire the seventeenth image through theseventeenth camera corresponding to the seventeenth camera 330-17illustrated in FIG. 15 may generate fifth encoded data based on theacquired seventeenth image.

In response to the operation of the apparatus 300 in a mode forgenerating a 3D omnidirectional image, the first processor 310-1 mayreceive audio associated with at least one image among the first toseventeenth images through the microphone 360-1 operatively connected tothe first processor 310-1. The first processor 310-1 may generate firstaudio encoded data based on the received audio. The first audio encodeddata may be independently decodable regardless of other encoded data.

The first processor 310-1 may configure the received first encoded data,the received second encoded data, the received third encoded data, thereceived fourth encoded data, the generated fifth encoded data, thereceived second audio encoded data, and the generated first audioencoded data as one data set for generating a 3D omnidirectional image.In the one data set, the encoded data may be arranged in the order ofthe first encoded data, the third encoded data, the fourth encoded data,the second encoded data, the fifth encoded data, the second audioencoded data, and the first audio encoded data, as illustrated in FIG.24. The first processor 310-1 may store the one data set in the memory320. The first processor 310-1 may transmit the configured single dataset to another apparatus (e.g., the electronic device 101 for stitching)through the communication interface 340. Each of the various datacontained in the stored or transmitted single data set may beindependently decodable.

As described above, in order to generate a 3D omnidirectional image, theapparatus 300 according to various embodiments may generate the first tofourth encoded data, the first audio encoded data, and the second audioencoded data. Since each of the first to fourth encoded data, the firstaudio encoded data, and the second audio encoded data is configured tobe independently decodable, an apparatus, which is provided with encodeddata through the apparatus 300 may generate a 2D omnidirectional image,a 2D panoramic image, a 3D panoramic image, or the like, rather than a3D omnidirectional image through selective decoding, even though theprovided encoded data has been generated through a mode for generating a3D omnidirectional image.

The apparatus 300 according to various embodiments may cause the imageacquisition time points of the first to sixteenth cameras 310-1 to310-16 to be matched through synchronization signals transmitted fromthe first processor 310-1 to the second to fifth processors 310-2 to310-5, or synchronization signals transmitted from the first camera330-1 to the first to sixteenth cameras 310-1 to 310-16. The apparatus300 according to various embodiments is capable of reducing noise thatmay occur during signaling of synchronization signals by converting thephases of at least some of the synchronization signals.

FIG. 25 illustrates still another example of the functionalconfiguration of an apparatus that controls image processing accordingto various embodiments of the disclosure. This functional configurationmay be included in the apparatus 300 illustrated in FIG. 3.

In FIG. 25, each of the components included in the apparatus 300 (e.g.,first to fifth processors 310-1 to 310-5, a memory 320, first tosixteenth cameras 330-1 to 330-16, a communication interface 340, amicrophone 360-1, and a microphone 360-2) may correspond to each of thecomponents included in the apparatus 300 illustrated in FIG. 24.

Referring to FIG. 25, in response to the operation of the apparatus 300in a mode for generating a 2D omnidirectional image, the first processor310-1 may request encoded data from the fifth processor 310-5 and thethird processor 310-3. Referring to FIG. 16, it may be required toacquire the second image, the fourth image, the sixth image, the eighthimage, the tenth image, the twelfth image, the fourteenth image, and thesixteenth image in order to generate the 2D omnidirectional image. Thefirst processor 310-1 may request encoded data, which is generated byencoding the tenth image, the twelfth image, the fourteenth image, andthe sixteenth image, from the fifth processor 310-5, which isoperatively connected to the tenth camera 330-10 configured to acquirethe tenth image, the twelfth camera 330-12 configured to acquire thetwelfth image, the fourteenth camera 310-14 configured to acquire thefourteenth image, and the sixteenth camera 330-16 configured to acquirethe sixteenth image. The first processor 310-1 may request encoded data,which is generated by encoding the second image, the fourth image, thesixth image, and the eighth image, from the third processor 310-3, whichis operatively connected to the second camera 330-2 configured toacquire the second image, the fourth camera 330-4 configured to acquirethe fourth image, the sixth camera 310-6 configured to acquire the sixthimage, and the eighth camera 330-8 configured to acquire the eighthimage.

The first processor 310-1 may transmit synchronization signals for thesynchronization of the second camera 330-2, the fourth camera 330-4, thesixth camera 330-6, the eighth camera 330-8, the tenth camera 330-10,the twelfth camera 330-12, the fourteenth camera 330-14, and thesixteenth camera 330-16. The synchronization signals may includeinformation associated with an operating frequency. For example, thefirst processor 310-1 may transmit the synchronization signals to eachof the second camera 330-2, the fourth camera 330-4, the sixth camera330-6, the eighth camera 330-8, the tenth camera 330-10, the twelfthcamera 330-12, the fourteenth camera 330-14, and the sixteenth camera330-16. Some of the transmitted synchronization signals may have a phasedifferent from the other ones of the transmitted synchronization signalsin order to reduce noise caused between the cameras.

As an example, the phase of the synchronization signal provided to eachof the tenth camera 330-10, the fourteenth camera 330-14, the secondcamera 330-2, and the sixth camera 330-6 may be different from the phaseof the synchronization signal provided to each of the twelfth camera330-12, the sixteenth camera 330-16, the fourth camera 330-4, and theeighth camera 330-8, which may be disposed adjacent to the fourteenthcamera 330-14, the second camera 330-2, and the sixth camera 330-6,respectively. The phase difference of the synchronization signals may be180 degrees.

As another example, the first processor 310-1 may transmit thesynchronization signals to each of the fifth processor 310-5 and thethird processor 310-3. Each of the transmitted synchronization signalsmay be received by each of the second camera 330-2, the fourth camera330-4, the sixth camera 330-6, the eighth camera 330-8, the tenth camera330-10, the twelfth camera 330-12, the fourteenth camera 330-14, and thesixteenth camera 330-16 through each of the fifth processor 310-5 andthe third processor 310-3. At least some of the second camera 330-2, thefourth camera 330-4, the sixth camera 330-6, the eighth camera 330-8,the tenth camera 330-10, the twelfth camera 330-12, the fourteenthcamera 330-14, and the sixteenth camera 330-16 may receive asynchronization signal, on which phase conversion is performed by atleast a part of the fifth processor 310-5 and the third processor 310-3,in order to reduce noise.

Since acquisition of the first image, the third image, the fifth image,the seventh image, the ninth image, the eleventh image, the thirteenthimage, and the fifteenth image may not be required in order to generatea 2D omnidirectional image, the first processor 310-1 may not requestencoded data from the second processor 310-2 and the fourth processor310-4. In various embodiments, the first processor 310-1 may controleach of the second PMIC 350-2 (not illustrated) and the fourth PMIC350-4, which are respectively connected to the second processor 310-2and the fourth processor 310-4, to interrupt power supplied to thesecond processor 310-2 and the fourth processor 310-4 that are not usedfor the generation of the 2D omnidirectional image or to reduce thepower supplied to the second processor 310-2 and the fourth processor310-4 which are not used for the generation of the 2D omnidirectionalimage.

In response to the request, the fifth processor 310-5 may acquire thetenth image through the tenth camera 330-10, may acquire the twelfthimage through the twelfth camera 330-12, may acquire the fourteenthimage through the fourteenth camera 330-14, and may acquire thesixteenth image through the sixteenth camera 330-16. The fifth processor310-5 may generate fourth encoded data based on the tenth image, thetwelfth image, the fourteenth image, and the sixteenth image. The fourthencoded data may be independently decodable regardless of the otherencoded data. The fifth processor 310-5 may provide the fourth encodeddata to the third processor 310-3.

In response to the request, the third processor 310-3 may acquire thesecond image through the second camera 330-2, may acquire the fourthimage through the fourth camera 330-4, may acquire the sixth imagethrough the sixth camera 330-6, and may acquire the eighth image throughthe eighth camera 330-8. The third processor 310-3 may generate secondencoded data based on the second image, the fourth image, the sixthimage, and the eighth image. The second encoded data may beindependently decodable regardless of the other encoded data.

The third processor 310-3 may receive audio associated with at least oneof the second image, the fourth image, the sixth image, the eighthimage, the tenth image, the twelfth image, the fourteenth image, and thesixteenth image through the microphone 360-2. The microphone 360-2 maynot be included in the apparatus 300 according to embodiments. Themicrophone 360-2 may be constituted with a plurality of sets or groupsof microphones according to embodiments. The third processor 310-3 maygenerate second audio encoded data based on the received audio. Thesecond audio encoded data may be independently decodable regardless ofother encoded data.

The third processor 310-3 may provide the second encoded data, thefourth encoded data, and the second audio encoded data to the firstprocessor 310-1. Each of the second encoded data, the fourth encodeddata, and the second audio encoded data provided to the first processor310-1 may be configured to be independently decodable.

In response to the operation of the apparatus 300 in a mode forgenerating a 2D omnidirectional image, the first processor 310-1 mayacquire the seventeenth image through the seventeenth camera and maygenerate fifth encoded data based on the acquired seventeenth image.

In response to the operation of the apparatus 300 in a mode forgenerating a 2D omnidirectional image, the first processor 310-1 mayreceive audio associated with at least one image among the acquiredimages through the microphone 360-1. The first processor 310-1 maygenerate first audio encoded data based on the received audio. The firstaudio encoded data may be independently decodable regardless of otherencoded data.

The first processor 310-1 may configure the received second encodeddata, the received fourth encoded data, the generated fifth encodeddata, the received second audio encoded data, and the generated firstaudio encoded data as one data set for generating the 2D omnidirectionalimage. In the one data set, the encoded data may be arranged in theorder of the fourth encoded data, the second encoded data, the fifthencoded data, the second audio encoded data, and the first audio encodeddata, as illustrated in FIG. 25. The first processor 310-1 may store theone data set in the memory 320. The first processor 310-1 may transmitthe configured single data set to another apparatus (e.g., theelectronic device 101 for stitching) through the communication interface340. The configured single data set may be transmitted to the otherapparatus in real time when the apparatus 300 operates in a mode forgenerating a 2D omnidirectional image. Each of the various datacontained in the stored or transmitted single data set may beindependently decodable.

As described above, the apparatus 300 according to various embodimentsis capable of reducing a calculation amount required for generatingencoded data in the apparatus 300 by connecting at least one camera,which is not used for generation of a 2D omnidirectional image, to aprocessor other than a processor connected to at least one camera, whichis used for generating a 2D omnidirectional image.

Since each of the second encoded data, the fourth encoded data, thefifth encoded data, the second audio encoded data, and the first audioencoded data, which are generated in the apparatus 300 according tovarious embodiments, is independently decodable, an apparatus that isprovided with encoded data through the apparatus 300 may generate a 2Dpanoramic image, rather than the 2D omnidirectional image, throughselective decoding, even though the provided encoded data has beengenerated through the mode for generating the 2D omnidirectional image.In other words, the apparatus 300 according to various embodiments mayreduce a calculation amount required in a decoding procedure and astitching procedure for generation of a final image.

FIG. 26 illustrates still another example of the functionalconfiguration of an apparatus that controls image processing accordingto various embodiments of the disclosure. This functional configurationmay be included in the apparatus 300 illustrated in FIG. 3.

In FIG. 26, each of the components included in the apparatus 300 (e.g.,first to fifth processors 310-1 to 310-5, a memory 320, first to sixthcameras 330-1 to 330-16, a communication interface 340, a microphone360-1, and a microphone 360-2) may correspond to each of the componentsincluded in the apparatus 300 illustrated in FIG. 24.

Referring to FIG. 26, in response to the operation of the apparatus 300in a mode for generating a 2D panoramic image, the first processor 310-1may request encoded data from the third processor 310-3. Referring toFIG. 16, it may be required to acquire the second image, the fourthimage, the sixth image, and the eighth image in order to generate the 2Dpanoramic image. The first processor 310-1 may request encoded data,which is generated by encoding the second image, the fourth image, thesixth image, and the eighth image, from the third processor 310-3, whichis operatively connected to the second camera 330-2 configured toacquire the second image, the fourth camera 330-4 configured to acquirethe fourth image, the sixth camera 330-6 configured to acquire the sixthimage, and the eighth camera 330-8 configured to acquire the eighthimage.

The first processor 310-1 may synchronize the second camera 330-2, thefourth camera 330-4, the sixth camera 330-6, and the eighth camera 330-8by transmitting a synchronization signal to each of the second camera330-2, the fourth camera 330-4, the sixth camera 330-6, and the eighthcamera 330-8 or by transmitting a synchronization signal to the thirdprocessor 310-3.

Since acquisition of the first image, the third image, the fifth image,the seventh image, the ninth to sixteenth images is not required togenerate a 2D panoramic image, the first processor 310-1 may not requestthe encoded data from the second processor 310-2, the fourth processor310-4, and the fifth processor 310-5. In various embodiments, the firstprocessor 310-1 may control each of the second PMIC 350-2 (notillustrated), the fourth PMIC 350-4 (not illustrated), and the fifthPMIC 350-5, which are respectively connected to the second processor310-2, the fourth processor 310-4, and the fifth processor 310-5 so asto interrupt the power supplied to each of the second processor 310-2,the fourth processor 310-4, and the fifth processor 310-5, which are notused for generating a 2D panoramic image, and to reduce the powersupplied to each of the second processor 310-2, the fourth processor310-4, and the fifth processor 310-5, which are not used for generatinga 2D panoramic image.

In response to the request, the third processor 310-3 may acquire thesecond image through the second camera 330-2, may acquire the fourthimage through the fourth camera 330-4, may acquire the sixth imagethrough the sixth camera 330-6, and may acquire the eighth image throughthe eighth camera 330-8. The third processor 310-3 may generate secondencoded data based on the second image, the fourth image, the sixthimage, and the eighth image. The second encoded data may beindependently decodable regardless of the other encoded data.

The third processor 310-3 may receive, through the microphone 360-2,audio associated with at least one of the second image, the fourthimage, the sixth image, the eighth image, the tenth image, the twelfthimage, the fourteenth image, and the sixth image. The third processor310-3 may generate second audio encoded data based on the receivedaudio. The second audio encoded data may be independently decodableregardless of other encoded data.

The third processor 310-3 may provide the second encoded data and thesecond audio encoded data to the first processor 310-1. Each of thesecond encoded data and the second audio encoded data, which areprovided to the first processor 310-1, may be configured to beindependently decodable.

In response to the operation of the apparatus 300 in a mode forgenerating a 2D panoramic image, the first processor 310-1 may acquirethe seventeenth image through the seventeenth camera and may generatefifth encoded data based on the acquired seventeenth image.

In response to the operation of the apparatus 300 in a mode forgenerating a 2D panoramic image, the first processor 310-1 may receiveaudio associated with at least one image among the acquired imagesthrough the microphone 360-1. The first processor 310-1 may generatefirst audio encoded data based on the received audio. The first audioencoded data may be independently decodable regardless of other encodeddata.

The first processor 310-1 may configure the received second encodeddata, the generated fifth encoded data, the received second audioencoded data, and the generated first audio encoded data as one data setfor generating the 2D panoramic image. In the one data set, the encodeddata may be arranged in the order of the second encoded data, the fifthencoded data, the second audio encoded data, and the first audio encodeddata, as illustrated in FIG. 26. The first processor 310-1 may store theone data set in the memory 320. The first processor 310-1 may transmitthe configured single data set to another apparatus through thecommunication interface 340. The configured single data set may betransmitted to the other apparatus in real time when the apparatus 300operates in a mode for generating a 2D panoramic image. Each of thevarious data contained in the stored or transmitted single data set maybe independently decodable.

As described above, the apparatus 300 according to various embodimentsis capable of reducing a calculation amount required for generatingencoded data in the apparatus 300 by connecting at least one camera,which is not used for generation of a 2D panoramic image, to a processorother than a processor connected to at least one camera, which is usedfor generating a 2D panoramic image.

FIG. 27 illustrates an example of the operation of an apparatus thatcontrols image processing according to various embodiments of thedisclosure. This operation may be performed by the apparatus 300illustrated in FIG. 3, the apparatus 300 illustrated in FIGS. 23 to 26,or a component of the apparatus 300 (e.g., the processor 310 of FIG. 3or the first processor 310-1 of FIGS. 23 to 26).

Referring to FIG. 27, in operation 2710, the first processor 310-1 maydetermine the mode of the apparatus 300. In various embodiments, thefirst processor 310-1 may determine the mode of the apparatus 300 inorder to determine at least one target processor to transmit a requestfor encoded data among a plurality of processors included in theapparatus 300. In various embodiments, the mode of the apparatus 300 maybe determined based on the input detected through the UI 2000illustrated in FIG. 20. In response to determining that the mode of theapparatus 300 is the first mode, the first processor 310-1 may performoperations 2720 to 2740. The first mode may be a mode in which use ofthe second processor (or the first camera 330-1 connected to the secondprocessor 310-2) among the second processor 310-2 and the thirdprocessor 310-3) is not required. In response to determining that themode of the apparatus 300 is the second mode, the first processor 310-1may perform operations 2750 to 2770. The second mode may be a mode inwhich use of the second processor 310-2 and the third processor 310-3 isused.

In operation 2720, in response to determining that the mode of theapparatus 300 is the first mode, the first processor 310-1 may requestencoded data from the third processor 310-3. The first processor 310-1may request the encoded data only from the third processor 310-3 inorder to reduce a calculation amount of for acquiring the encoded data.The third processor 310-3 may receive the request.

In operation 2730, the first processor 310-1 may receive the secondencoded data from the third processor 310-3. The second encoded data maybe generated in the third processor 310-3 based on the image acquiredthrough the second camera 310-2 operatively connected to the thirdprocessor 310-3. The received second encoded data may be independentlydecodable.

In operation 2740, the first processor 310-1 may process the secondencoded data as one data set. In various embodiments, the firstprocessor 310-1 may store the one data set including the second encodeddata in the memory 320 of the apparatus 300. In various embodiments,when the second camera 310-2 is constituted with a plurality of cameras,the second encoded data may be independently decodable for each of aplurality of images acquired from each of the plurality of cameras.Information on each of the plurality of images may be included in thesecond encoded data in an order corresponding to the arrangement of eachof the plurality of cameras. In various embodiments, the first processor310-1 may transmit the one data set including the second encoded data toanother apparatus (e.g., the electronic device 101).

In operation 2750, in response to determining that the mode of theapparatus 300 is the second mode, the first processor 310-1 may requestencoded data from the second processor 310-2 and the third processor310-3. Since the second mode requires image acquisition and encoding ofthe second processor 310-2, the first processor 310-1 may requestencoded data from the second processor 310-2 and the third processor310-3. Each of the second processor 310-2 and the third processor 310-3may receive the request.

In operation 2760, the first processor 310-1 may receive the firstencoded data and the second encoded data from the third processor 310-3.The first encoded data may be generated based on the image acquiredthrough the first camera 330-1 operatively connected to the secondprocessor 310-2. The first encoded data may be provided from the secondprocessor 310-2 to the first processor 310-1 through the third processor310-3. The first encoded data may be independently decodable regardlessof whether the second encoded data is decoded. The second encoded datamay be generated based on the image acquired through the second camera310-2 operatively connected to the third processor 310-3. The secondencoded data may be independently decodable regardless of whether thefirst encoded data is decoded.

In operation 2770, the first processor 310-1 may process the firstencoded data and the second encoded data as one data set. Processing thefirst encoded data and the second encoded data as the one data set maybe a concept distinct from combining the first encoded data and thesecond encoded data. The first encoded data may be configuredindependently of the second encoded data in the one data set and thesecond encoded data may be configured independently of the first encodeddata in the one data set. In various embodiments, the first processor310-1 may store the one data set in the memory 320 of the apparatus 300.In various embodiments, the first processor 310-1 may transmit the onedata set to another apparatus (e.g., the electronic device 101). Theother apparatus receiving the one data set may acquire informationassociated with the image acquired through the first camera 330-1 byextracting and decoding only the first encoded data in the one data set.The other apparatus receiving the one data set may acquire informationassociated with the image acquired through the second camera 330-2 byextracting and decoding only the second encoded data in the one dataset. In other words, each of the first encoded data and the secondencoded data in the transmitted single data set may be independentlydecodable.

As described above, the apparatus 300 according to various embodimentsis capable of reducing a calculation amount required for imageacquisition and image processing by generating and providingindependently decodable encoded data. The apparatus 300 according tovarious embodiments is capable of reducing a calculation amount requiredfor image acquisition and image processing by selectively driving theprocessor according to the mode of the apparatus 300.

FIG. 28 illustrates an example of a signal flow in an apparatus thatcontrols power according to various embodiments of the disclosure. Thissignal flow may be caused in the apparatus illustrated in FIG. 3 and theapparatus 300 illustrated in FIGS. 23 to 26.

Referring to FIG. 28, in operation 2810, the first processor 310-1 maydetermine the mode of the apparatus 300. The first processor 310-1 maydetermine the mode of the apparatus 300 in order to specify an objectfrom which encoded data will be requested. When the first processor310-1 determines that the mode of the apparatus 300 is the first mode inwhich calculation by the second processor 310-2 is not required,operations 2820 to 2850 may be performed in the apparatus 300. Unlikethis, when the first processor 310-1 determines that the mode of theapparatus 300 is the second mode in which calculation by the secondprocessor 310-2 is required, operations 2855 to 2875 may be performed inthe apparatus 300.

In operation 2820, in response to determining that the mode of theapparatus 300 is the first mode, the first processor 310-1 may requestencoded data only from the third processor 310-3. Since the apparatus300 is configured such that the calculation by the second processor310-2 is not required in the first mode, the first processor 310-1 mayrequest the encoded data only from the third processor 310-3.

In operation 2830, in response to determining that the mode of theapparatus 300 is the first mode, the first processor 310-1 may transmita control signal for interrupting power, provided to the secondprocessor 310-2, to the second PMIC 350-2 operatively connected to thesecond processor 310-2. Since the apparatus 300 is configured such thatthe calculation by the second processor 310-2 is not required in thefirst mode, the first processor 310-1 may transmit a control signal fordeactivating the second processor 310-2. The second PMIC 350-2 mayreceive the control signal.

Operation 2820 and operation 2830 may be performed simultaneously or inreverse order. In other words, operation 2820 and operation 2830 may beperformed regardless of order.

In operation 2835, the second PMIC 310-2 may interrupt power supplied tothe second processor 310-2.

In operation 2840, in response to the request, the third processor 310-3may provide, to the first processor 310-1, the second encoded datagenerated based on the image acquired from the second camera 330-2. Thefirst processor 310-1 may receive the second encoded data.

Operation 2830 and operation 2840 may be performed simultaneously or inreverse order. In other words, operation 2830 and operation 2840 may beperformed regardless of order.

In operation 2850, the first processor 310-1 may store only the secondencoded data in the memory 320 as one data set. The first processor310-1 may store the one data set in the memory 320 in order topost-process the one data set or to transmit the one data set to anotherapparatus.

In operation 2855, in response to determining that the mode of theapparatus 300 is the second mode, the first processor 310-1 may requestencoded data from the third processor 310-3. The third processor 310-3may receive the request.

In operation 2860, in response to determining that the mode of theapparatus 300 is the second mode, the first processor 310-1 may requestencoded data from the second processor 310-2. The second processor 310-2may receive the request.

Operation 2855 and operation 2860 may be performed simultaneously or inreverse order. In other words, operation 2855 and operation 2860 may beperformed regardless of order.

In operation 2865, in response to the request, the second processor310-2 may transmit, to the third processor 310-3, the first encoded datagenerated based on the image acquired through the first camera 330-1.The first encoded data may be independently decodable. The thirdprocessor 310-3 may receive the first encoded data.

In operation 2870, in response to the request, the third processor 310-3may provide, to the first processor 310-1, the second encoded datagenerated based on the image acquired through the second camera 330-2and the received first encoded data. The second encoded data may beindependently decodable. The first processor 310-1 may receive the firstencoded data and the second encoded data.

In operation 2875, the first processor 310-1 may store the first encodeddata and the second encoded data as one data set. The first processor310-1 may store the one data set in order to post-process the one dataset constituted with the first encoded data and the second encoded dataor to transmit the one data set to another apparatus. In other words,each of the first encoded data and the second encoded data in thetransmitted single data set may be independently decodable in theapparatus 300 or the other apparatus.

FIG. 29 illustrates an example of an operation of another apparatus thatreceives a data set according to various embodiments of the disclosure.This operation may be performed by the electronic device 101 illustratedin FIG. 1 or the processor 120 in the electronic device 101.

Referring to FIG. 29, in operation 2910, the processor 120 may receiveat least one data set from another apparatus (e.g., the apparatus 300).The at least one data set may be configured by the apparatus 300. Forexample, the at least one data set may be constituted with the firstencoded data and the second encoded data. As another example, the atleast one data set may be constituted only with the second encoded data.

In operation 2920, the processor 120 may determine the configuration ofthe at least one data set. In various embodiments, the processor 120 maydetermine the configuration of the at least one data set in response tothe reception. The processor 120 may perform operation 2930 based ondetermining that the configuration of the at least one data set is afirst configuration. Unlike this, the processor 120 may performoperations 2940 and 2950 based on determining that the configuration ofthe at least one data set is a second configuration.

In operation 2930, based on determining that the configuration of the atleast one data set is the first configuration, the processor 120 maydecode only the second encoded data to generate a 2D image file. Sincethe at least one data set may be constituted only with the secondencoded data, the processor 120 may acquire the second encoded data fromthe at least one data set, and may decode the acquired second encodeddata, thereby generating a 2D image file as the final image.

In operation 2940, based on determining that the configuration of the atleast one data set is the second configuration, the processor 120 maydecode the first encoded data to generate a first 2D image file, and maydecode the second encoded data to generate a second 2D image file. Eachof the first encoded data and the second encoded data may beindependently decodable and may be used to generate an independent imagefile.

In operation 2950, the processor 120 may generate a 3D image file basedon the first 2D image file and the second 2D image file. The processor120 may synthesize (or stitch) the first 2D image file and the second 2Dimage file to generate the 3D image file.

Unlike operation 2950 of FIG. 29, the processor 120 may use only thefirst 2D image file as the final image file, or may use only the second2D image file as the final image file. In other words, since each of thefirst encoded data and the second encoded data is independentlydecodable, the processor 120 may adaptively use a file generated basedon the first encoded data and a file generated based on the secondencoded data.

FIG. 30 illustrates an example of the functional configuration of anelectronic device that processes an audio signal according to variousembodiments of the disclosure. This functional configuration may beincluded in the apparatus 300 illustrated in FIG. 3.

FIG. 31 illustrates an example of the operation of a processor thatprocesses an audio signal according to various embodiments of thedisclosure.

In FIG. 30, the electronic device 101 may be an electronic device thatreceives a plurality of images and a plurality of audio signals for anomnidirectional image from the apparatus 300 illustrated in FIG. 3, etc.The electronic device 101 may be an electronic device that generates theomnidirectional image or an electronic device that reproduces theomnidirectional image.

Referring to FIG. 30, the electronic device 101 may include a processor120, a memory 130, an input device 150, and a display device 160.

The processor 120 may be operatively connected to the memory 130, theinput device 150, and the display device 160. The processor 120 maycontrol the memory 130, the input device 150, and the display device 160through the connection.

In various embodiments, the processor 120 may display a plurality ofimages for the omnidirectional image through the display device 160 byexecuting a plurality of instruction words stored in the memory 130. Theprocessor 120 may display the plurality of images for editing of theomnidirectional image. For example, the processor 120 may display theplurality of images in order to change the reference direction of theomnidirectional image from the first direction to the second direction.The displayed plurality of images may be acquired based on the firstdirection (or using a specific camera as a central camera) in theapparatus 300 or the like. The processor 120 may display the pluralityof images within an UI of an application for changing the referencedirection of the omnidirectional image.

In various embodiments, the processor 120 may detect, through the inputdevice 150, an input for changing the reference direction of theomnidirectional image by executing a plurality of instruction wordsstored in the memory 130. The processor 120 may detect an input forchanging the reference direction of the omnidirectional image from thefirst direction to the second direction. The input may include an inputfor selecting a k^(th) image corresponding to the second direction amongthe displayed plurality of images. For example, the input for selectingthe k^(th) image may be a long touch input, a drag input, a double tapinput, a force touch input, or the like for the k^(th) image.

In various embodiments, in response to detecting (or receiving) theinput, the processor 120 may identify a plurality of first audio signalsfor the omnidirectional image by executing a plurality of instructionwords stored in the memory 130. The plurality of first audio signals maybe respectively acquired through a plurality of microphones while theplurality of images are being acquired. The processor 120 may identifythe plurality of first audio signals from the data set received from theapparatus 300. Each of the plurality of first audio signals may be asignal received through the plurality of microphones. Each of theplurality of first audio signals may be received through the pluralityof microphones capable of adaptively changing a gain (or a recordingmode) according to what the reference direction is.

In various embodiments, in response to detecting (or receiving) theinput, the processor 120 may determine a difference value between thefirst direction and the second direction by executing a plurality ofinstruction words stored in the memory 130. The difference value may beused to adjust the plurality of first audio signals in accordance withthe change of the reference direction. The difference value may be usedto generate a plurality of second audio signals changed from theplurality of first audio signals. For example, each of the plurality ofsecond audio signals may constitute a plurality of channel audio data.For example, each of the plurality of second audio signals may be outputthrough each of the plurality of channels. The difference value may bedetermined based on a positional relationship between the firstdirection and the second direction. The difference value may include atleast one of a parameter indicating an angle and a parameter indicatingan orientation. The difference value may indicate the number of imagesarranged between an m^(th) image corresponding to the first directionamong the plurality of images and the k^(th) image corresponding to thesecond direction among the plurality of images. In various embodiments,the difference value may be replaced by another value. For example, thedifference value may be replaced with a value indicating an orientationto the reference direction (or a center view). In various embodiments,information on the difference value may be obtained together with theplurality of first audio signals.

In various embodiments, during acquisition of the plurality of images,when the reference direction is changed from the first direction to thesecond direction, the processor 120 may change the order of encoded datafor each of a plurality of images acquired using the plurality ofcameras. In some embodiments, the processor 120 may transmit, to theother apparatus, information on the difference value, which isdetermined according to the changed order of the encoded data for eachof the plurality of images. The other apparatus may generate the secondaudio signals based on the received information. In some otherembodiments, the processor 120 may generate the plurality of secondaudio signals matched in the second direction and may transmitinformation on the plurality of second audio signals to the otherapparatus by changing the order (or combination) of the plurality offirst images in accordance with the changed order of the encoded datafor each of the plurality of images.

In various embodiments, the processor 120 may generate the plurality ofsecond audio signals changed from the plurality of first audio signalsbased on the determined difference value by executing the plurality ofinstruction words stored in the memory 130. The plurality of secondaudio signals may be audio signals corresponding to the omnidirectionalimage using the second direction as a reference direction. Each of theplurality of second audio signals may be respectively associated with aplurality of channels for a surround effect. For example, the pluralityof channels may include a left channel of 5.1 channels, a right channelof the 5.1 channels, a center channel of the 5.1 channels, a surroundleft channel of the 5.1 channels, a surround right channel of the 5.1channels, and a woofer channel of the 5.1 channels. Each of theplurality of second audio signals may be output through each of theplurality of channels. For example, the plurality of second audiosignals may include an output device for the left channel of the 5.1channels, an output device for the right channel of the 5.1 channels, anoutput device for the center channel of the 5.1 channels, an outputdevice for the surround left channel of the 5.1 channels, an outputdevice for the surround right channel of the 5.1 channels, and an outputdevice for the woofer channel of the 5.1 channels.

For example, referring to FIG. 31, the processor 120 may provide thedetermined difference value to each of the input units 3110-1 to 3110-5.Each of the input units 3110-1 to 3110-5 may correspond to a pluralityof channels. For example, the input unit 3110-1 may be configured forthe left channel of the 5.1 channels, the input unit 3110-2 may beconfigured for the right channel of the 5.1 channels, the input unit3110-3 may be configured for the center channel of the 5.1 channels, theinput unit 3110-4 may be configured for the surround left channel of the5.1 channels, and the input unit 3110-5 may be configured for thesurround right channel of the 5.1 channels.

The processor 120 may provide the plurality of first audio signals torespective input units 3110-1 to 3110-5. For example, the processor 120may provide the plurality of first audio signals to respective inputunits 3110-1 to 3110-5.

The input unit 3110-1 may determine a combination of the plurality offirst audio signals corresponding to (or suitable for) a channelassociated with the input unit 3110-1, based on the provided differencevalue. As an example, the input unit 3110-1 may determine at least onefirst audio signal among the plurality of first audio signals as asignal corresponding to the left channel of the 5.1 channels (e.g., atleast one audio signal received through at least one microphone disposedon the left side of a camera corresponding to the second direction)based on the provided difference value. As another example, the inputunit 3110-4 may determine at least one other audio signal among theplurality of first audio signals as a signal corresponding to thesurround left channel of the 5.1 channels based on the provideddifference value. In various embodiments, at least some of one or moreother audio signals may be common to at least some of one or more audiosignals. In various embodiments, all of the one or more other audiosignals may not be common to all of the one or more audio signals.

Each of the input units 3110-1 to 3110-5 may provide information on atleast one determined audio signal to each of delay compensation units3120-1 to 3120-5. Each of the delay compensation units 3120-1 to 3120-5may be used to compensate for a delay caused by a difference in positionbetween a plurality of microphones that acquire the plurality of firstaudio signals. Each of the delay compensation units 3120-1 to 3120-5 maycompensate for a delay of the at least one audio signal received in eachof the delay compensating units 3120-1 to 3120-5. For example, each ofthe delay compensation units 3120-1 to 3120-5 may compensate for a delayof the at least one audio signal such that each of the plurality ofsecond audio signals is output in a state of being synchronized.

Each of the delay compensation units 3120-1 to 3120-5 may provide the atleast one audio signal, for which the delay has been compensated, toweighted-value application units 3130-1 to 3130-5.

Each of the weight application units 3130-1 to 3130-5 may be providedwith information on the difference value. Each of the weight applicationunits 3130-1 to 3130-5 may be provided the at least one audio signal,for which the delayed has been compensated.

Each of the weight application units 3130-1 to 3130-5 may retrieveinformation on a weight based on the difference value and the at leastone audio signal. The information on the weight may include data for atleast one weight to be applied to the at least one audio signal. Theinformation on the weight may be used to provide beam-forming ordirectionality to the plurality of second audio signals. The informationon the weight may be stored in advance in the memory 130. In theinformation on the weight, the data for the at least one weight may beassociated with the difference value. For example, a difference value amay be associated with first data for the at least one weight, and adifference value b may be associated with second data for the at leastone weight. The data for the at least one weight may be configured foreach combination of at least some of the plurality of first audiosignals.

Each of the weight application units 3130-1 to 3130-5 may acquire atleast one weight corresponding to the difference value and the at leastone audio signal from the information on the weight. Each of the weightapplication units 3130-1 to 3130-5 may generate each of the plurality ofsecond audio signals by applying the acquired at least one weight to theat least one audio signal.

In the processor 120, each of the generated plurality of second audiosignals may be an audio signal corresponding to the omnidirectionalimage the reference direction of which is changed in the seconddirection. Each of the plurality of second audio signals may be outputthrough an output device in the electronic device 101 or an outputdevice in another apparatus connected to the electronic device.

FIG. 31 illustrates an example of processing, in the electronic device101 receiving a plurality of images and a plurality of audio signalsfrom the apparatus 300, the plurality of audio signals. It should benoted that, independent of the illustration of FIG. 31, in variousembodiments, the apparatus 300 is capable of processing the plurality ofaudio signals. For example, the apparatus 300 according to variousembodiments may include a first camera and a second camera, and mayinclude one or more first transducers corresponding to the first cameraand one or more second transducers corresponding to the second camera.When the first camera is configured as a central camera, the apparatus300 is capable of acquiring the plurality of audio signals through theone or more first transducers. By acquiring the plurality of audiosignals through the one or more first transducers, the apparatus 300 iscapable of acquiring audio that is matched with the central imageacquired through the first camera as the central camera. For example,audio data in the central direction, which is contained in the acquiredaudio and corresponds to the central image, may have a higher gain thanaudio data in at least one direction other than the central direction.When the second camera is configured as a central camera, the apparatus300 is capable of acquiring the plurality of other audio signals throughthe one or more second transducers. By acquiring the plurality of otheraudio signals through the one or more second transducers, the apparatus300 is capable of acquiring audio that is matched with the central imageacquired through the second camera as the central camera. For example,audio data in the central direction, which is contained in the acquiredaudio and corresponds to the central image, may have a higher gain thanaudio data in at least one direction other than the central direction.

As described above, when the reference direction of the omnidirectionalimage is changed from the first direction to the second direction, theelectronic device 101 according to various embodiments is capable ofchanging a plurality of first audio signals for the omnidirectionalimage to a plurality of second audio signals based on a difference valuebetween the first direction and the second direction. Through the abovechange, the electronic device 101 according to various embodiments iscapable of resolving a mismatch between an audio signal and anomnidirectional image due to a change in the reference direction. Evenif the reference direction of the image acquisition procedure is changedin the other direction with this change, the electronic device 101according to various embodiments is capable of compensating for this.

FIG. 32 illustrates another example of changing a direction of audio inan electronic device according to various embodiments of the disclosure.Such an example may be configured in the electronic device 101 of FIG.1, the electronic device 101 of FIG. 30, or the processor 120 includedin the electronic device 101.

Referring to FIG. 32, the processor 120 may process a plurality ofimages 3200. The plurality of images 3200 may be images acquired orgenerated with reference to the direction corresponding to a k^(th)image. The plurality of images 3200 may be images for anomni-directional image and may have a k^(th) image as a reference image.The plurality of first audio signals associated with the plurality ofimages 3200 may be acquired in consideration of being output ortransmitted as in a view 3220. For example, the plurality of first audiosignals may be audio signals configured to correspond to the case inwhich the k^(th) image is a reference image. Each of the plurality offirst audio signals may include an audio signal for the left side of thek^(th) image, an audio signal for the right side, an audio signal forthe center, an audio signal for the left rear side, and an audio signalfor the right rear side.

The processor 320 may receive an input for changing the referencedirection of the plurality of images 3200 from the first direction tothe second direction. The input may be received from an external device.The second direction may correspond to the first image among theplurality of images 3200. The processor 320 may change the referencedirection of the omnidirectional image from the first direction to thesecond direction in response to receiving the input. The processor 320may calculate a difference value between the first direction and thesecond direction in response to receiving the input. The processor 320may allocate at least one of the plurality of first audio signals toeach of the plurality of second audio signals based on the differencevalue. The processor 320 may generate each of the plurality of secondaudio signals by applying a weight to the at least one audio signal.Each of the plurality of second audio signals may be generated based ona positional relationship between a camera corresponding to the seconddirection and a plurality of microphones receiving the plurality offirst audio signals. For example, each of the plurality of second audiosignals may include an audio signal received through at least onemicrophone disposed on the left of the camera corresponding to thesecond direction, an audio signal received through at least onemicrophone disposed on the right of the camera corresponding to thesecond direction, an audio signal received through at least onemicrophone disposed around the camera corresponding to the seconddirection, an audio signal received through at least one microphonedisposed on the rear left of the camera corresponding to the seconddirection, and an audio signal received through at least one microphonedisposed on the rear right of the camera corresponding to the seconddirection. Each of the plurality of second audio signals may be a signalto which a change of directivity (e.g., rotation 3260) is applied, as inview 3255. Through the change of this directivity, the electronic device101 is capable of generating a plurality of second audio signals thatare matched with the omnidirectional image, the reference direction ofwhich has been changed.

FIG. 33 illustrates an example of an operation of an apparatus thatprocesses an audio signal according to various embodiments of thedisclosure. Such an operation may be performed by the electronic device101 illustrated in FIG. 1, the electronic device 101 illustrated in FIG.30, or the processor 120 included in the electronic device 101.

Referring to FIG. 33, in operation 3310, the processor 120 may receivean input for changing the reference direction of the omnidirectionalimage from the first direction to the second direction. The referencedirection may be a direction disposed at the front of the user at thetime of starting reproduction of the omnidirectional image. The inputmay be received from an external device. The reference direction may bea direction that is a reference for the omnidirectional image. Thereference direction may be a direction set in a procedure of acquiring aplurality of images for the omnidirectional image. The referencedirection set in the procedure for acquiring the plurality of images maybe inconsistent with a main direction to be used at the time ofreproduction depending on a context included in the plurality of images.In order to overcome this inconsistency, a change in the referencedirection may be required in the electronic device 101.

In operation 3320, the processor 120 may generate the plurality ofsecond audio signals changed from the plurality of first audio signalsbased on a difference value between the first direction and the seconddirection. The processor 120 may determine at least one of the pluralityof first audio signals to be allocated for each of the plurality ofsecond audio signals based on the difference value. The processor 120may generate the plurality of second audio signals by applying a weightcorresponding to each of the plurality of second audio signals to thedetermined at least one audio signal. The plurality of second audiosignals may be configured to be output in the second direction as areference direction. The plurality of second audio signals may begenerated or output together with the plurality of images forreproduction of the omnidirectional image.

FIG. 34 illustrates an example of an operation of an electronic devicethat generates a plurality of second audio signals according to variousembodiments of the disclosure. Such an operation may be performed by theelectronic device 101 illustrated in FIG. 1, the electronic device 101illustrated in FIG. 30, or the processor 120 included in the electronicdevice 101.

Operations 3410 to 3430 of FIG. 34 may correspond to operation 3320 ofFIG. 33.

In operation 3410, the processor 120 may allocate at least one of theplurality of first audio signals to each of the plurality of secondaudio signals based on the difference value. In other words, theprocessor 120 may determine a combination of the plurality of firstaudio signals for each of the plurality of second audio signals to begenerated, based on the difference value.

In operation 3420, the processor 120 may apply a weight to the at leastone audio signal to generate each a plurality of second audio signals.The processor 120 may generate each of the plurality of second audiosignals by applying a delay that varies depending on the changeddirection to the at least one audio signal. For example, the processor120 may determine a weight to be applied to the at least one audiosignal using the information on the weights illustrated in FIG. 31. Theprocessor 120 may generate each of the plurality of second audio signalsby applying a weight acquired from the information on the weighted tothe at least one audio signal.

In operation 3430, the processor 120 may process the plurality of secondaudio signals. For example, the processor 120 may output each of theplurality of second audio signals through an output device correspondingto each of the plurality of channels for reproduction of theomnidirectional image. As another example, the processor 120 may storethe plurality of second audio signals for post-processing orreproduction of the omnidirectional image. As another example, theprocessor 120 may transmit information on the plurality of second audiosignals to another apparatus for reproduction of the omnidirectionalimage in the other apparatus.

FIG. 35 illustrates an example of the plurality of generated secondaudio signals according to various embodiments of the disclosure.

The plurality of second audio signals illustrated in FIG. 35 may beconfigured for 5.1 channels. The plurality of second audio signalsillustrated in FIG. 35 may include a signal for left (or front left) of5.1 channels, a signal for right (or front right) of 5.1 channels, asignal for center of 5.1 channels, a signal for surround left of 5.1channels, and a signal for a surround right of 5.1 channels.

Referring to FIG. 35, graph 3510 may represent a plurality of secondaudio signals generated according to various embodiments when therotation of the reference direction is 0 degrees.

Graph 3530 may represent a plurality of second audio signals generatedaccording to various embodiments when the rotation of the referencedirection is 45 degrees. When comparing graph 3510 and graph 3530, itcan be seen that the plurality of second audio signals are rotatedaccording to the change of the reference direction. In other words, theelectronic device 101 according to various embodiments may provide anaudio signal corresponding to a changed reference direction of theomnidirectional image.

Graph 3550 may represent a plurality of second audio signals generatedaccording to various embodiments when the rotation of the referencedirection is 90 degrees. When comparing graph 3510 and graph 3550, itcan be seen that the plurality of second audio signals are rotatedaccording to the change of the reference direction. In other words, theelectronic device 101 according to various embodiments may provide anaudio signal corresponding to a changed reference direction of theomnidirectional image.

Graph 3570 may represent a plurality of second audio signals generatedaccording to various embodiments when the rotation of the referencedirection is 135 degrees. When comparing graph 3510 and graph 3570, itcan be seen that the plurality of second audio signals are rotatedaccording to the change of the reference direction. In other words, theelectronic device 101 according to various embodiments may provide anaudio signal corresponding to a changed reference direction of theomnidirectional image.

FIG. 36 illustrates an example of the functional configuration of anapparatus that compensates for distortion according to variousembodiments of the disclosure. This functional configuration may beincluded in the apparatus 300 illustrated in FIG. 3.

FIG. 37 illustrates an example of a method for determining informationfor compensating for distortion according to various embodiments of thedisclosure.

FIG. 38 illustrates an example of an image for compensating fordistortion according to various embodiments of the disclosure.

FIG. 39 illustrates another example of an image for compensating fordistortion according to various embodiments of the disclosure.

FIG. 40 illustrates another example of a method for determininginformation for compensating for distortion according to variousembodiments of the disclosure.

Referring to FIG. 36, an apparatus 300 may include a processor 310, amemory 320, a plurality of memories (e.g., memories 3600-1 to 3600-n), aplurality of cameras (e.g. first to n^(th) cameras 330-1 to 330-n), anda communication interface 340.

The processor 310 may be operatively connected to each of the first ton^(th) cameras 330-1 to 330-n. The processor 310 may acquire a pluralityof images through the first to n^(th) cameras 330-1 to 330-n.

Each of the first and n^(th) cameras 330-1 to 330-n may be used toacquire a plurality of images for generating an omnidirectional image ora panoramic image. Among the first to n^(th) cameras 330-1 to 330-n, thefirst camera 330-1 is exposed through a part of the top face of thehousing of the apparatus 300, and among the second to n^(th) cameras330-1 to 330-n, each of cameras other than the first camera 330-1 may beexposed through a part of the side face of the housing. In other words,the first camera 330-1 may be disposed on a face different from the facewhere the other cameras are disposed. Each of the first and n^(th)camera 330-1 to 330-n may be operatively connected to each of theplurality of memories 3600-1 to 3600-n.

Each of the first to n^(th) cameras 330-1 to 330-n may be disposed inthe housing of the apparatus 300 to have a designated FOV. At least oneof the first to n^(th) cameras 330-1 to 330-n may be disposed in thehousing to have an FOV different from the designated FOV due to an erroroccurring during the manufacturing process or an error occurring duringuse of the apparatus 300. The FOV different from the designated FOV maycause a change in the positional relationship between the plurality ofimages. In other words, at least one image acquired through the at leastone camera having the FOV different from the designated FOV may havedistortion. Each of the first to n^(th) cameras 330-1 to 330-n may beprovided with information for compensating for the distortion from eachof the memories 3600-1 to 3600-n. At least one camera having an FOVdifferent from the designated FOV among the first to n^(th) camera 330-1to 330-n may transmit information for compensating for the distortion tothe processor 310.

The processor 310 may perform signaling with each of the first to n^(th)cameras 330-1 to 330-n. In various embodiments, the processor 310 mayreceive information for compensating for distortion from at least one ofthe first to n^(th) cameras 330-1 to 330-n. The information forcompensating for the distortion may be caused when at least one of thefirst to n^(th) cameras 330-1 to 330-n has an FOV different from the FOVdesignated for the at least one camera. For example, when the at leastone camera is connected to (or disposed in) the housing of the apparatus300 to be different from a target, the at least one camera may have anFOV different from a designated FOV (or a targeted FOV) of the at leastone camera. For example, the at least one camera may be arranged at aposition different from a targeted position in the housing due to anerror that occurred during the manufacture of the apparatus 300 or anerror that occurred due to an impact during the use of the apparatus300. Due to this arrangement, the at least one camera may have an FOVdifferent from the designated FOV. The information for compensating forthe distortion may be used to adjust the distortion of an image causedby such an FOV.

As another example, in the at least one camera, due to an error thatoccurred in the manufacturing process of the apparatus 300 or an errorthat occurred by an impact during the use of the apparatus, a positionalrelationship between an image sensor included in the at least one cameraand a lens included in the at least one camera may become different froma designated positional relationship (or a targeted positionalrelationship). Due to such a positional relationship, the at least onecamera may have an FOV different from the designated FOV. Theinformation for compensating for the distortion may be used to reducethe distortion of an image caused by such an FOV.

The processor 310 may transmit, through the communication interface 340,information on a plurality of images including at least one image havingthe distortion to another apparatus (e.g., the electronic device 101)that generates the final image. The processor 310 may transmitinformation for compensating for the distortion to the other devicethrough the communication interface 340. The information forcompensating for the distortion may be used in the other apparatus inorder to modify or correct at least some of the plurality of images in aprocedure for generating the final image.

The information for compensating for the distortion may be determinedbased on the position of a reference object included in the imageacquired through the at least one camera. For example, referring to FIG.37, in conceptual view 3700, the processor 310 may acquire a first imageincluding a reference object 3170 through the first camera 330-1 exposedthrough a part of the top face of the housing in a first state in whichthe housing is tilted from horizontality by a designated elevation angle3715. The designated elevation angle 3715 is set such that the first ton^(th) (or k^(th)) cameras 330-1 to 330-n (or 330-k) can be set toacquire an image for the reference object 3710 simultaneously. Thedesignated elevation angle 3715 may be, for example, 45 degrees. Inconceptual diagram 3750, the processor 310 is capable of acquiring asecond image including a reference object 3710 through the first camera330-1 in a second state, which is rotated by a designated azimuth angle3755 from the first state. For example, referring to FIG. 38, theprocessor 310 is capable of acquiring the first image 3810 through thefirst camera 330-1 in the first state, and is capable of acquiring thesecond image 3820 through the first camera 330-1 in the second state. Inthe example of FIG. 38, the azimuth angle 3755 may be 180 degrees. Whenthe first camera 330-1 has an FOV different from the designated FOV, thepositional relationship between the first image 3810 and the secondimage 3820 may be represented as in an image 3830. When the first image3810 is rotated by an angle corresponding to the azimuth angle 3755, theposition of the reference object in the first image 3810 may beinconsistent with the reference object in the second image 3820, as inthe image 3830. Through this image analysis, the processor 310 iscapable of determining that the first camera 330-1 has an FOV differentfrom the designated FOV. The processor 310 may determine that the firstcamera 330-1 has torsion of axis therein. The processor 310 maydetermine at least one value, which makes the position, obtained byrotating the reference object in the first image 3810 by the angle,consistent with the position of the reference object in the second image3820, as the information for compensating for the distortion of theimage acquired through the first camera 330-1. The at least one valuemay include at least one of a value representing pitch rotation, a valuerepresenting yaw rotation, or a value representing roll rotation.

The designated elevation angle 3715 may not be an essential element. Forexample, by adjusting the position of the reference object 3710 to beincluded in the FOV of the first camera 330-1 and in the FOV of anothercamera (e.g., the k^(th) camera 330-k or the n^(th) camera 330), theapparatus 300 may perform the operations described in reference to FIGS.36 to 42 without being tilted by the designated elevation angle 3715.

As another example, referring to FIG. 37, in conceptual view 3700, theprocessor 310 may acquire a first image including the reference object3710 through the first camera 330-1 in the first state and may acquire athird image including the reference object 3710 through the n^(th)camera 330-n in the first state. In conceptual view 3750, the processor310 may acquire a second image including the reference object 3710through the first camera 330-1 in the second state, and may acquire afourth image including the reference object 3710 through the k^(th)camera 330-k in the second state. The k^(th) camera 330-k may bedetermined differently depending on the magnitude of the azimuth angle3755. The processor 310 may determine that the position of the referenceobject obtained by rotating the reference object in the first image 3810by the angle is consistent with the position of the reference object inthe second image 3820. When the first camera 330-1 does not have torsionof axis or the torsion of axis of the first camera 330-1 is compensatedfor by the example described above, the torsion of axis of at least oneof the n^(th) camera 330-n and the k^(th) camera 330-k may becompensated for. Referring to FIG. 39, the processor 310 may acquire thethird image 3910 through the n^(th) camera 330-n in the first state, andthe k^(th) camera 330-k may acquire the fourth image 3920 through thek^(th) camera 330-k in the second state. In the example of FIG. 39, theazimuth angle 3755 may be 180 degrees. When the n^(th) camera 330-n orthe k^(th) camera 330-k has an FOV different from the designated FOV,the positional relationship between the third image 3910 and the fourthimage 3920 may be represented as in an image 3930. As in the image 3930,when at least one of the n^(th) camera 330-n and the k^(th) camera 330-khas torsion of axis, the position of the reference object in the thirdimage 3910 may not be consistent with the position of the referenceobject in the fourth image 3920. The processor 310 may determine atleast one value that makes the position compensated in the third image3910 based on the azimuth angle 3755 consistent with the position of thereference object in the fourth image 3920, as information forcompensating for the distortion of the image acquired through at leastone of the n^(th) camera 330-n and the k^(th) camera 330-k. The at leastone value may include at least one of a value representing pitchrotation, a value representing yaw rotation, or a value representingroll rotation.

In various embodiments, the processor 310 may adjust the torsion of axisof the at least one camera, which is caused by the positionalrelationship between the at least one camera and the housing, and thetorsion of axis of the at least one camera, which is caused by thepositional relationship between the lens in the at least one camera andthe image sensor in the at least one camera. For example, referring toFIG. 40, in conceptual view 4000, the processor 310 may acquire an imageincluding a reference object 4010 spaced apart from the apparatus 300 bya first distance and an image including a reference object 4020 spacedapart from the apparatus 300 by a second distance different from thefirst distance. Based on the method described with reference to FIGS. 37to 39, the processor 310 may compensate for the torsion of axis of theat least one camera, which is caused by the positional relationshipbetween the at least one camera and the housing, as well as the torsionof axis of the at least one camera, which is caused by the positionalrelationship between the lens in the at least one camera and the imagesensor in the at least one camera.

As described above, in the apparatus 300 according to variousembodiments, the processor 310 may generate information for compensatingfor an error at least one of a plurality of cameras included in theapparatus 300 has (e.g., having an FOV different from the designated FOVand torsion of axis) based on at least one of: a position of an objectin an image acquired through a camera exposed through a portion of thetop face of the housing in a first state in which the housing of theapparatus 300 is tilted; a position of an object in an image acquiredthrough a camera exposed through a portion of the top face in a secondstate in which the housing of the apparatus 300 is rotated from thefirst state; a position of an object in an image acquired through acamera exposed through a portion of the side face of the housing in thefirst state; and a position of an object in an image acquired throughanother camera exposed through a portion of the side face of the housingin the second state. With this information, the device 300 maycompensate for the distortion contained in the image in thepost-processing operation of the acquired image.

FIG. 41 illustrates another example of an operation of an apparatus thattransmits information for compensating for distortion in an imageaccording to various embodiments of the disclosure. Such an operationmay be performed by the apparatus 300 illustrated in FIG. 3, theapparatus 300 illustrated in FIG. 36, or the processor 310 included inthe apparatus 300.

Referring to FIG. 41, in operation 4110, the processor 310 may acquire aplurality of images through a plurality of cameras (e.g., the first ton^(th) cameras 330-1 to 330-n). Among the plurality of cameras, thefirst camera 330-1 may be exposed through a portion of the top face ofthe housing of the apparatus 300, and each of the cameras other than thefirst camera 330-1 among the plurality of cameras may be exposed througha portion of the side face of the housing of the apparatus 300. Forexample, the first image acquired through the first camera 330-1 may beassociated with a scene in the upper portion of the housing, and each ofthe images acquired through the other cameras may be associated with ascene of the side portion of the housing. The processor 310 may generateencoded data for the plurality of images.

In operation 4120, the processor 310 may send, to another apparatus,information on the plurality of images and information for compensatingfor at least one distortion contained in at least one of the pluralityof images. For example, the other apparatus may include the electronicdevice 101 illustrated in FIG. 1 as an apparatus that stitches theplurality of images. The information for compensating for the at leastone distortion may be stored in the apparatus 300 during the manufactureof the apparatus 300 and may be stored in the apparatus 300 during theuse of the apparatus 300. The information for compensating for the atleast one distortion may be stored in at least some of a plurality ofmemories connected to each of the plurality of cameras or may be storedin the memory 320 connected to the processor 310.

As described above, in order to ensure that a distortion caused due toat least one camera arranged different from a targeted design can becompensated for in an image processing operation, the apparatus 300according to various embodiments may provide information forcompensating for the distortion to the other apparatus or may store theinformation for compensating for the distortion thereon. With thisinformation, the apparatus 300 is capable of generating a final imagehaving desired quality without adjusting the physical position of the atleast one camera.

FIG. 42 illustrates an example of an operation of an apparatus thatprovides a compensation mode according to various embodiments of thedisclosure. Such an operation may be performed by the apparatus 300illustrated in FIG. 3, the apparatus 300 illustrated in FIG. 36, or theprocessor 310 included in the apparatus 300.

Referring to FIG. 42, in operation 4210, the processor 310 may detect aninput for entering a compensation mode. The apparatus 300 may provide acompensation mode for compensating for the torsion of axis of at leastone camera, or the like. The processor 310 may detect an input forentering a compensation mode through reception of designated input(e.g., a long touch input, a double tap input, a force touch input, or adrag input), or reception of an input for an object for entering acompensation mode.

In operation 4220, the processor 310 may enter the compensation mode inresponse to the detection of the input. For example, in the compensationmode, the processor 310 may display a UI that guides the operationdescribed with reference to FIGS. 37 to 40 and the like.

In operation 4230, the processor 310 may acquire a plurality of imagesincluding an object for compensation in the compensation mode. Theobject for compensation may correspond to the reference object of FIGS.37 to 40. The processor 310 may acquire a plurality of images includingthe object in order to detect and compensate for an error in the atleast one camera.

In operation 4240, the processor 310 may determine information forcompensating for at least one distortion based at least some of theplurality of images including the object for compensating for thedistortion. For example, the processor 310 may determine information forcompensating for the at least one distortion based on the methoddescribed with reference to FIGS. 37-40.

In operation 4250, the processor 310 may process the determinedinformation. In various embodiments, the processor 310 may store thedetermined information. In various embodiments, the processor 310 maytransmit the determined information to another apparatus. In variousembodiments, the processor 310 may update information for compensatingfor the at least one distortion.

As described above, the apparatus 300 according to various embodimentsmay provide information for compensating in a digital method for adistortion due to the placement of at least one of the plurality ofcameras included in the apparatus 300. Through the provision of thisinformation, the apparatus 300 or the other apparatus that generates animage based on a plurality of images acquired through the device 300 iscapable of providing a final image with quality above designatedquality.

An electronic device according to various embodiments disclosed abovemay include: a first camera group including a first camera disposed in afirst optical axis direction and a second camera disposed in a secondoptical axis direction, and having a first FOV; a second camera groupincluding a third camera disposed in a third optical axis direction anda fourth camera disposed in a fourth optical axis direction, and havinga second FOV covering an area at least partially different from an areacovered by the first FOV; a first processor configured to process imagesacquired through the first camera group; a second processor configuredto process images acquired through the second camera group; and adesignated processor configured to control the first processor and thesecond processor. The processor may be configured to: select anoperation mode associated with the 1st processor or the 2nd processor,based at least on an input associated with the 1st camera group or the2nd camera group; when the operation mode is selected as a firstoperation mode, acquire an image covering the first FOV using firstimages processed through the first processor; and when the operationmode is selected as a second operation mode, acquire an image coveringthe first FOV and the second FOV using the first images processedthrough the first processor and second images processed through thesecond processor.

In various embodiments, at least a part of the first camera group may beincluded in the second camera group, and the second FOV may cover anarea at least partially overlapping an area covered by the first FOV.

In various embodiments, each of the image covering the first FOV and theimage covering the second FOV may be independently decodable in theelectronic device.

In various embodiments, the designated processor may be configured torestrict power supplied to the second processor when the operation modeis selected as the first operation mode.

An apparatus according to various embodiments described above mayinclude: a first camera pair including a first camera configured to beoriented in a first direction and a second camera configured to beoriented in a second direction corresponding to the first direction, thefirst camera having a first FOV and the second camera having a secondFOV partially overlapping the first FOV; at least one memory; a firstprocessor; a second processor connected to the first camera; and a thirdprocessor connected to the second camera. The first processor may beconfigured to: in response to the apparatus operating in a first modefor generating a 2D image, request encoded data from the thirdprocessor, receive, from the third processor, second encoded data on animage acquired through the second camera, and store the second encodeddata in the at least one memory as one data set; and in response to theapparatus operating in a second mode for generating a 3D image, requestencoded data from the second processor and the third processor, receive,from the third processor, a first encoded data on an image obtainedthrough the first camera and the second encoded data on the imageobtained through the second camera, and store the first encoded data andthe second encoded data in the at least one memory as the one data set.

In various embodiments, each of the first encoded data and the secondencoded data may be independently decodable in the apparatus or anotherapparatus connected to the apparatus.

In various embodiments, the first encoded data may be received by thefirst processor from the second processor through the third processor.

In various embodiments, the first processor may be configured to controlturning off power provided to the second processor and the fourthprocessor in response to the apparatus operating in the first mode. Theapparatus may further include a first PMIC connected to the firstprocessor, a second PMIC connected to the second processor, and a thirdPMIC connected to the third processor. The first processor may beconfigured to control turning off power provided to the second processorby transmitting a control signal to the second PMIC in response to theapparatus operating in the first mode.

According to various embodiments, the apparatus may further include acommunication interface, and the first processor may be configured totransmit the stored one data set to another apparatus connected to theapparatus.

In various embodiments, the apparatus may further include a displayconnected to the first processor, and the first processor may be furtherconfigured to: display a menu including a first object indicating thefirst mode and a second object indicating the second mode through thedisplay; control that the apparatus operates in the first mode inresponse to detecting at least one input on the first object; andcontrol that the apparatus operates in the second mode in response todetecting at least one input on the second object.

According to various embodiments, the apparatus may further include athird camera connected to the second processor and a fourth cameraconnected to the third processor. The first processor may be configuredto: in response to the apparatus operating in the first operation mode,request the encoded data from the third processor, receive, from thethird processor, the second encoded data generated based on an imageacquired through the second camera and an image acquired through thefourth camera, and store the second encoded data in the at least onememory as the one data set; and in response to the apparatus operatingin the second operation mode, request the encoded data from the secondprocessor and the third processor, receive, from the third processor,the first encoded data generated based on an image acquired through thefirst camera and an image acquired through the third camera and thesecond encoded data generated based on an image acquired through thesecond camera and an image acquired through the fourth camera, store thefirst encoded data and the second encoded data in the at least onememory as the one data set. The second processor may be configured togenerate the first encoded data based on the image acquired through thefirst camera and the image acquired through the third camera in responseto the request from the first processor, and the third processor may beconfigured to generate the second encoded data based on the imageacquired through the second camera and the image acquired through thefourth camera in response to the request from the first processor. Thesecond processor may be configured to transmit the first encoded data tothe third processor when the apparatus operates in the second operationmode, and the third processor may be configured to transmit, to thefirst processor, the first encoded data and the second encoded datareceived from the second processor.

In various embodiments, the first processor may be configured to: whenthe stored one data set is only configured with the second encoded data,generate a reproducible 2D image file by decoding only the secondencoded data; and when the stored one data set is configured with thefirst encoded data and the second encoded data, generate a reproduciblefirst 2D image file by decoding the first encoded data, generate areproducible second 2D image file by decoding the second encoded data,and generate a reproducible 3D image file based on the first 2D imagefile and the second 2D image.

In various embodiments, the apparatus may further include a third cameraconnected to the first processor and configured to be oriented in athird direction substantially perpendicular to the first direction andthe second direction, the third camera having a third FOV partiallyoverlapping the first FOV and the second FOV, and the first processormay be configured to: in response to the apparatus operating in thefirst operation mode, request the encoded data from the third processor,generate third encoded data on an image acquired through a third camera,and receive the second encoded data from the third processor, and storethe second encoded data and the third encoded data in the at least onememory as the one data set; and in response to the apparatus operatingin the second operation mode, request the encoded data from the secondprocessor and the third processor, generate third encoded data on animage acquired through the third camera, receive the first encoded dataand the second encoded data from the third processor, and store thefirst encoded data, the second encoded data, and the third encoded datain the at least one memory as the one data set. Each of the firstencoded data, the second encoded data, and the third encoded data may beindependently decodable in the apparatus or another apparatus connectedto the apparatus.

According to various embodiments, the apparatus may further include: asecond camera pair including a third camera configured to be oriented ina third direction and a fourth camera configured to be oriented in afourth direction corresponding to the third direction, the third camerahaving a third FOV and the fourth camera having a fourth FOV partiallyoverlapping the third FOV; a third camera pair including a fifth cameraconfigured to be oriented in a fifth direction and a sixth cameraconfigured to be oriented in a sixth direction corresponding to thefifth direction, the fifth camera having a fifth FOV and the sixthcamera having a sixth FOV partially overlapping the fifth FOV; a fourthcamera pair including a seventh camera configured to be oriented in aseventh direction and an eighth camera configured to be oriented in aneighth direction corresponding to the seventh direction, the seventhcamera having a seventh FOV and the eighth camera having an eighth FOVpartially overlapping the seventh FOV; a fifth camera pair including aninth camera configured to be oriented in a ninth direction and a tenthcamera configured to be oriented in a tenth direction corresponding tothe ninth direction, the ninth camera having a ninth FOV and the tenthcamera having a tenth FOV partially overlapping the ninth FOV; a sixthcamera pair including an eleventh camera configured to be oriented in aneleventh direction and a twelfth camera configured to be oriented in atwelfth direction corresponding to the eleventh direction, the eleventhcamera having an eleventh FOV and the twelfth camera having a twelfthFOV partially overlapping the eleventh FOV; a seventh camera pairincluding a thirteenth camera configured to be oriented in a thirteenthdirection and a fourteenth camera configured to be oriented in afourteenth direction corresponding to the thirteenth direction, thethirteenth camera having a thirteenth FOV and the fourteenth camerahaving a fourteenth FOV partially overlapping the thirteenth FOV; aneighth pair of cameras including a fifteenth camera configured to beoriented in a fifteenth direction and a sixteenth camera configured tobe oriented in a sixteenth direction corresponding to the fifteenthdirection, the fifteenth camera having a fifteenth FOV and the sixteenthcamera having a sixteenth FOV partially overlapping the fifteenth FOV; afourth processor connected to the ninth camera, the eleventh camera, thethirteenth camera, and the fifteenth camera; and a fifth processorconnected to the tenth camera, the twelfth camera, the fourth camera,and the sixteenth camera. The second processor may be further connectedto the third camera, the fifth camera, and the seventh camera, and thethird processor may be further connected to the fourth camera, the sixthcamera, and the eighth camera. In various embodiments, the first FOV maypartially overlap the third FOV and the fifteenth FOV, the second FOVmay partially overlap the fourth FOV and the sixteenth FOV, the thirdFOV may partially overlap the first FOV and the fifth FOV, the fourthFOV may partially overlap the second FOV and the sixth FOV, the fifthFOV may partially overlap the third FOV and the seventh FOV, the sixthFOV may partially overlap the fourth FOV and the eighth FOV, the seventhFOV may partially overlap the fifth FOV and the ninth FOV, the eighthFOV may partially overlap the sixth FOV and the tenth FOV, the ninth FOVmay partially overlap the seventh FOV and the eleventh FOV, the tenthFOV may partially overlap the eighth FOV and the twelfth FOV, theeleventh FOV may partially overlap the ninth FOV and the thirteenth FOV,the twelfth FOV may partially overlap the tenth FOV and the fourteenthFOV, the thirteen FOV may partially overlap the eleventh FOV and thefifteenth FOV, the fourteenth FOV may partially overlap the twelfth FOVand the sixteenth FOV, the fifteenth FOV may partially overlap the firstFOV and the thirteenth FOV, and the sixteenth FOV may partially overlapthe second FOV and the fourteenth FOV. The first processor may beconfigured to: request the encoded data from the third processor and thefifth processor in response to the apparatus operating in the firstmode; receive, from the third processor, a second encoded data, which isgenerated based on an image acquired through the second camera, an imageacquired through the fourth camera, an image acquired through the sixthcamera, and an image acquired through the eighth camera, and a fourthencoded data, which is generated based on an image acquired through thetenth camera, an image acquired through the twelfth camera, an imageacquired through the fourteenth camera, and an image acquired throughthe sixteenth camera; store the second encoded data and the fourthencoded data in the at least one memory as the one data set; request theencoded data from the second processor, the third processor, the fourthprocessor, and the fifth processor in response to the apparatusoperating in the second mode; receive, from the third processor, thefirst encoded data, which is generated based on an image acquiredthrough the first camera, an image acquired through the third camera, animage acquired through the fifth camera, and an image acquired throughthe seventh camera, the second encoded data, which is generated based onan image acquired through the second camera, an image acquired throughthe fourth camera, an image acquired through the sixth camera, and animage acquired through the eighth camera, the third encoded data, whichis generated based on an image acquired through the ninth camera, animage acquired through the eleventh camera, an image acquired throughthe thirteenth camera, and an image acquired through the fifteenthcamera, and the fourth encoded data, which is generated based on animage acquired through the tenth camera, an image acquired through thetwelfth camera, an image acquired through the fourteenth camera, and animage acquired through the sixteenth camera; and store the first encodeddata, the second encoded data, the third encoded data, and the fourthencoded data in the at least one memory as the one data set. Each of thefirst encoded data, the second encoded data, the third encoded data, andthe fourth encoded data may be independently decodable in the apparatusor another apparatus connected to the apparatus.

In various embodiments, the apparatus may further include a microphoneconnected to the first processor, and the first processor may beconfigured: in response to the apparatus operating in the first mode,request the encoded data from the third processor, generate thirdencoded data based on audio acquired through the at least onemicrophone, receive the second encoded data from the third processor,and store the second encoded data and the third encoded data in the atleast one memory as the one data set; and in response to the apparatusoperating in the second mode, request the encoded data from the secondprocessor and the third processor, generate the third encoded data basedon audio acquired through the at least one microphone, receive the firstencoded data and the second encoded data from the third processor, andstore the first encoded data, the second encoded data, and the thirdencoded data in the at least one memory as the one data set.

In various embodiments, the apparatus may further include acommunication interface, and the first processor may be furtherconfigured to, when the apparatus operates in the first mode, transmitthe second encoded data to another apparatus connected to the apparatusas the one data set in response to receiving the second encoded data.

An apparatus according to various embodiments described above mayinclude a communication interface and a processor, and the processor maybe configured to: receive one data set from another apparatus includinga plurality of cameras through the communication interface; when the onedata set is configured only with the second encoded data, which isgenerated based on an image acquired through the second camera among theplurality of cameras, generate a reproducible 2D image file by decodingonly the second encoded data; and when the one data set is configuredwith the first encoded data, which is generated based on an imageacquired through the first camera among the plurality of cameras and thesecond encoded data, which is generated based on an image acquiredthrough the second camera among the plurality of cameras, generate afirst 2D image file that is reproducible by decoding the first encodeddata, generate a second 2D image file that is reproducible by decodingthe second encoded data, and generate a reproducible 3D image file basedon the first 2D image file and the second 2D image file.

In various embodiments, the first camera may be configured to beoriented in the first direction in the other apparatus, and may have afirst FOV, the second camera may be configured to be oriented in thesecond direction corresponding to the first direction in the otherapparatus, and may have a second FOV partially overlapping the firstFOV, and the first camera and the second camera may form a camera pairin the other apparatus.

Methods stated in claims and/or specifications according to variousembodiments may be implemented by hardware, software, or a combinationof hardware and software.

When the methods are implemented by software, a computer-readablestorage medium for storing one or more programs (software modules) maybe provided. The one or more programs stored in the computer-readablestorage medium may be configured for execution by one or more processorswithin the electronic device. The at least one program may includeinstructions that cause the electronic device to perform the methodsaccording to various embodiments of the disclosure as defined by theappended claims and/or disclosed herein.

The programs (software modules or software) may be stored innon-volatile memories including a random access memory and a flashmemory, a ROM, an EEPROM, a magnetic disc storage device, a CD-ROM,digital versatile discs (DVDs), or other type optical storage devices,or a magnetic cassette. Alternatively, any combination of some or all ofthe may form a memory in which the program is stored. Further, aplurality of such memories may be included in the electronic device.

In addition, the programs may be stored in an attachable storage devicewhich may access the electronic device through communication networkssuch as the Internet, Intranet, LAN, wide LAN (WLAN), and storage areanetwork (SAN) or a combination thereof. Such a storage device may accessthe electronic device via an external port. Further, a separate storagedevice on the communication network may access a portable electronicdevice.

In the above-described detailed embodiments of the disclosure, acomponent included in the disclosure is expressed in the singular or theplural according to a presented detailed embodiment. However, thesingular form or plural form is selected for convenience of descriptionsuitable for the presented situation, and various embodiments of thedisclosure are not limited to a single element or multiple elementsthereof. Further, either multiple elements expressed in the descriptionmay be configured into a single element or a single element in thedescription may be configured into multiple elements.

While the disclosure has been shown and described with reference tovarious embodiments thereof, it will be understood by those skilled inthe art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the disclosure as definedby the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a 1st camera group comprising a 1st camera disposed in a 1st direction of an optical axis and a 2nd camera disposed in a 2nd direction of the optical axis, the 1st camera group having a 1st field of view (FOV); a 2nd camera group comprising a 3rd camera disposed in a 3rd direction of the optical axis and a 4th camera disposed in a 4th direction of the optical axis, the 2nd camera group having a 2nd FOV covering an area at least partially different from an area covered by the 1st FOV; a 1st processor for processing images obtained through the 1st camera group; a 2nd processor for processing images obtained through the 2nd camera group; and a designated processor for controlling the 1st processor and the 2nd processor, wherein the designated processor is configured to: select an operation mode associated with at least one of the 1st processor or the 2nd processor, based on an input associated with at least one of the 1st camera group or the 2nd camera group, if the operation mode is selected as a 1st operation mode: receive from the 1st processor 1st data corresponding to the images processed by the 1st processor, and obtain an image covering the 1st FOV by using the 1st data, and if the operation mode is selected as a 2nd operation mode: receive from the 1st processor the 1st data and 2nd data corresponding to the images processed by the 2nd processor, and obtain an image covering the 1st FOV and the 2nd FOV by using the 1st data and the 2nd data.
 2. The electronic device of claim 1, wherein at least a portion of the 1st camera group includes the 2nd camera group, and wherein the 2nd FOV covers an area that at least partially overlaps the area covered by the 1st FOV.
 3. The electronic device of claim 1, wherein at least a portion of an image covering the 1st FOV or an image covering the 2nd FOV is decodable by using at least one of the 1st processor or the 2nd processor.
 4. The electronic device of claim 1, wherein the designated processor is further configured to restrict power provided to the 2nd processor if the operation mode is selected as the 1st operation mode.
 5. An apparatus comprising: a 1st pair of cameras comprising a 1st camera in a 1st orientation and a 2nd camera in a 2nd orientation, the 1st camera having a 1st field of view (FOV) and the 2nd camera having a 2nd FOV that partially overlaps with the 1st FOV; at least one memory; a 1st processor; a 2nd processor coupled to the 1st camera; and a 3rd processor coupled to the 2nd camera, wherein the 1st processor is configured to: in response to the apparatus operating in a 1st operation mode for generating a two-dimensional space (2D) image: request encoding data to the 3rd processor, receive, from the 3rd processor, 2nd encoding data of an image obtained through the 2nd camera, and store, in the at least one memory, the 2nd encoding data as one data set, and in response to the apparatus operating in a 2nd operation mode for generating a three-dimensional space (3D) image: request encoding data to the 2nd processor and the 3rd processor, receive, from the 3rd processor, a 1st encoding data on an image obtained through the 1st camera and the 2nd encoding data on an image obtained through the 2nd camera, and store, in the at least one memory, the 1st encoding data and the 2nd encoding data as the one data set.
 6. The apparatus of claim 5, wherein each of the 1st encoding data and the 2nd encoding data is independently decodable in the apparatus or another apparatus connected with the apparatus.
 7. The apparatus of claim 5, wherein the 1st processor is further configured to control to turn off power provided to the 2nd processor, based at least on the apparatus operating in the 1st operation mode.
 8. The apparatus of claim 7, further comprising: a 1st power management integrated circuit (PMIC) coupled to the 1st processor; a 2nd PMIC coupled to the 2nd processor; and a 3rd PMIC coupled to the 3rd processor, wherein the 1st processor is further configured to control to turn off the power provided to the 2nd processor by using the 2nd PMIC, based at least on the apparatus operating in the 1st operation mode.
 9. The apparatus of claim 5, further comprising: a communication interface, wherein the 1st processor is further configured to transmit the stored one data set to a designated external electronic device.
 10. The apparatus of claim 5, further comprising: a display coupled to the 1st processor, wherein the 1st processor is further configured to: display an interface including a 1st object indicating the 1st operation mode and a 2nd object indicating the 2nd operation mode, control that the apparatus operates in the 1st operation mode, based at least on detecting at least one input on the 1st object, and control that the apparatus operates in the 2nd operation mode, based at least on detecting at least one input on the 2nd object.
 11. The apparatus of claim 5, further comprising: a 3rd camera coupled to the 2nd processor; and a 4th camera coupled to the 3rd processor, wherein the 1st processor is further configured to: in response to the apparatus operating in the 1st operation mode, request the encoding data to the 3rd processor, receive the 2nd encoding data generated based on an image obtained through the 2nd camera and an image obtained through the 4th camera, and store, in the at least one memory, the 2nd encoding data as the one data set, and in response to the apparatus operating in the 2nd operation mode, request the encoding data to the 2nd processor and the 3rd processor, receive, from the 3rd processor, the 1st encoding data generated based on an image obtained through the 1st camera and an image obtained through the 3rd camera and the 2nd encoding data generated based on an image obtained through the 2nd camera and an image obtained through the 4th camera, store, in the at least one memory, the 1st encoding data and 2nd encoding data as the one data set.
 12. The apparatus of claim 11, wherein the 2nd processor is configured to generate the 1st encoding data based on the image obtained through the 1st camera and the image obtained through the 3rd camera in response to the request from the 1st processor, and wherein the 3rd processor is configured to generate the 2nd encoding data based on the image obtained through the 2nd camera and the image obtained through the 4th camera.
 13. The apparatus of claim 12, wherein the 2nd processor is further configured to transmit the 1st encoding data to the 3rd processor if the apparatus operates in the 2nd operation mode, and wherein the 3rd processor is further configured to transmit the 1st encoding data that is received from the 2nd processor and the 2nd encoding data, to the 1st processor.
 14. The apparatus of claim 5, wherein the 1st processor is further configured to: if the stored one data set is only configured with the 2nd encoding data, generate a 2D image file by decoding only the 2nd encoding data, and if the stored one data set is configured with the 1st encoding data and the 2nd encoding data, generate a 1st 2D image file by decoding the 1st encoding data, generate a 2nd 2D image file by decoding the 2nd encoding data, and generate a 3D image file based on the 1st 2D image file or the 2nd 2D image file.
 15. The apparatus of claim 5, further comprising: a 3rd camera in a 3rd orientation coupled to the 1st processor, the 3rd orientation substantially perpendicular to the 1st orientation and the 2nd orientation, and the 3rd camera having a 3rd FOV that partially overlaps with the 1st FOV and partially overlaps with the 2nd FOV, wherein the 1st processor is configured to: in response to the apparatus operating in the 1st operation mode, request the encoding data to the 3rd processor, generate 3rd encoding data on an image obtained through the 3rd camera, and receive the 2nd encoding data from the 3rd processor, and store, in the at least one memory, the 2nd encoding data and the 3rd encoding data as the one data set, and in response to the apparatus operating in the 2nd operation mode, request the encoding data to the 2nd processor and the 3rd processor, generate 3rd encoding data on an image obtained through the 3rd camera, receive the 1st encoding data and the 2nd encoding data from the 3rd processor, and store, in the at least one memory, the 1st encoding data, the 2nd encoding data, and the 3rd encoding data as the one data set, wherein each of the 1st encoding data, the 2nd encoding data, and the 3rd encoding data is independently decodable in the apparatus or another apparatus connected to the apparatus.
 16. The apparatus of claim 5, further comprising: at least one microphone coupled to the 1st processor, wherein the 1st processor is configured to: in response to the apparatus operating in the 1st operation mode, request the encoding data to the 3rd processor, generate 3rd encoding data based on audio obtained through the at least one microphone, receive the 2nd encoding data from the 3rd processor, and store, in the at least one memory, the 2nd encoding data and the 3rd encoding data as the one data set, and in response to the apparatus operating in the 2nd operation mode, request the encoding data to the 2nd processor and the 3rd processor, generate the 3rd encoding data based on audio obtained through the at least one microphone, receive the 1st encoding data and the 2nd encoding data from the 3rd processor, and store, in the at least one memory, the 1st encoding data, the 2nd encoding data, and the 3rd encoding data as the one data set.
 17. The apparatus of claim 5, further comprising: a communication interface, wherein the 1st processor is further configured to if the apparatus operates in the 1st operation mode, transmit, to an external device connected to the apparatus, the 2nd encoding data as the one data set in response to receiving the 2nd encoding data.
 18. An apparatus comprising: a communication interface; and a processor, wherein the processor is configured to: receive, through the communication interface from another apparatus comprising a plurality of cameras, one data set, if the one data set is configured with 2nd encoding data generated based on an image obtained through a 2nd camera among the plurality of cameras, generate a two dimensional space (2D) image file by decoding the 2nd encoding data, and if the one data set is configured with 1st encoding data generated based on an image obtained through a 1st camera among the plurality of cameras and an image obtained through the 2nd camera among the plurality of cameras: generate a 1st 2D image file that is reproducible by decoding the 1st encoding data, generate a 2nd 2D image file that is reproducible by decoding the 2nd encoding data, and generate a three dimensional space (3D) image file based on the 1st 2D image file and the 2nd 2D image file.
 19. The apparatus of claim 18, wherein the 1st camera is inclined in a 1st orientation in the other apparatus, and has a 1st field of view (FOV), wherein the 2nd camera is inclined in a 2nd orientation corresponding to the 1st orientation in the other apparatus, and has a 2nd FOV partially overlapping with the 1st FOV, and wherein the 1st camera and the 2nd camera form a pair of cameras in the other apparatus. 